I 


AD-A263  502 


lAGAMHUt-Sia 


ADVISORY  GROUP  FOR  AEROSMCE  RESEARCH  &  DEVELOPMENT 

7  RUE  ANCELLE  92200  NEUILLY  SUR  SEINE  FRANCE 


ACMRD  ADVISORY  REPORT  313 

Mission  Planning  Systems 
for  Tactical  Aircraft 
(Pre-Flight  and  In-Fli^t) 

Systtoes  de  Planification  des  Missions  pour 
Avions  Tactiques  (Avant  Vol  et  en  Vol) 


S 


DTIC 


.ICTF 
APR  2  6  1993 

B 


This  report  has  been  prepared  at  the  request  of  the  Avionics  Panel  and 
Aerospace  Medical  Panel  ofAGARD. 


N 

lO 

DO 


I 

CO 

O) 


NORTH  ATLANTIC  TREATY  ORGANIZATION 


pistiUBU^ON  STATEMElfri 


Ayprorrcd  for  pobUe  r«l«aM} 
DUUtbutlnu  Unlimltod 


Publialwd  D«o«(nb«ri992 
Dl$trlbutk)n  wKl  AvaHabi^  on  Back  Co¥9r 

K 


AGARD-AR-313 


ADVISORY  GROUP  FOR  AEROSPACE  RESEARCH  &  DEVELOPMENT 

7  RUE  ANCELLE  92200  NEUILLY  SUR  SEINE  FRANCE 


AGARD  ADVISORY  REPORT  313 

Mission  Planning  Systems 
for  Tactical  Aircraft 
(Pre-Flight  and  In-Flight) 

Systemes  de  Planification  des  Missions  pour  Avions  Tactiques 
(Avant  Vol  et  en  Vol) 


I  his  report  has  been  prepared  at  the  request  of  the  Avitrnies  Panel  and 
Aerospace  Medical  Panel  of  AGARD. 


North  Atlantic  Treaty  Organization 
Organisation  du  Traitd  de  I’Atlantique  Nord 


9 


The  Mission  of  AGARD 


According  to  its  Charter,  the  mission  of  AGARD  is  to  bring  together  the  leading  personalities  of  the  NATO  nations  in  the  fields 
of  science  and  technology  relating  to  aerospace  for  the  following  purposes: 

—  Recommending  effective  ways  for  the  member  nations  to  use  their  research  and  development  capabilities  for  the 
common  benefit  of  the  NATO  community; 

—  Providing  scientific  and  technical  advice  and  assistance  to  the  Military  Committee  in  the  field  of  aerospace  research  and 
development  (with  particular  regard  to  its  military  application); 

—  Continuously  stimulating  advances  in  the  aerospace  sciences  relevant  to  strengthening  the  common  defence  posture; 

—  Improving  the  co-operation  among  member  nations  in  aerospace  research  and  development; 

—  exchange  of  scientific  and  technical  information; 

—  Providing  assistance  to  member  nations  for  the  purpose  of  increasing  their  seientific  and  technical  potential: 

Rciulcring  scientific  and  technical  assistan»'e.  as  requested,  to  other  NATO  bodies  and  to  member  nations  in  connection 
with  research  and  development  problems  in  the  aerospace  field, 

I’hc  highest  authoritv  vvithin  AC.iARD  is  the  National  Delegates  Board  consisting  of  officially  appointed  senior  representativ  es 
trom  each  member  nation.  The  mission  of  .ACiARD  is  carried  out  through  the  Panels  which  are  composed  of  experts  appointed 
bv  the  National  Delegates,  the  Consultant  and  F.xchange  Programme  and  the  .Aerospace  \pplications  Studies  Programme.  The 
results  of  .ACi.ARD  work  are  reported  to  the  member  nations  and  the  .NATO  Authorities  through  the  .AGARD  series  of 
publications  ol  which  this  is  one. 

Participation  in  AGARD  activities  is  bv  invitatioi  only  and  is  normally  limited  to  citizens  of  the  N.ATO  nations. 


riic  content  of  this  publication  has  been  reproduced 
direcllv  trom  material  supplied  by  .A('i.ARD  or  the  authors 
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Mission  Planning  is  not  new  in  concept,  and  as  applied  to  military  aircraft  missions,  it  must  have  been  carried  out  from  the  very 
earliest  days.  Recent  events  have  combined  to  increase  interest  in  the  .subject,  and  the  Air  Forces  of  many  of  the  NATO  nations 
are  taking  steps  to  develop  and  procure  mission  planning  systems  that  have  capabilities  far  in  advance  of  those  previously 
available.  In  addition,  increased  interest  is  being  shown  in  using  airborne  computer-based  systems  to  plan  and  re-plan  missions 
while  they  are  in  progress. 

There  are  several  reasons  for  this  interest,  and  these  include  both  the  technological  push  resulting  from  the  advances  in 
computers  and  their  peripherals  that  have  recently  become  available,  and  the  needs  of  the  Air  Forces  which  are  changing  as  their 
perception  of  future  military  scenarios  change.s.  Recent  experience  from  Operation  "Desert  Storm”  is  also  likely  to  increase 
interest  in  more  capable  mission  planning  systems,  including  those  having  a  mission  rehearsal  capability. 

.\Ci.\RD  Joint-Working  Group  15  was  established  to  review  mi.ssion  planning  systems  and  to  consider  how  they  are  likely  to 
evohe  in  the  future.  Its  terms  of  reference  specified  a  programme  of  two  phases  and  the  work  carried  out  in  the  first  of  these  was 
previously  published  as  AGARD  Advisory  Report  296.  This  report  covers  the  work  of  Phase  Two.  The  Working  Gump  r"et  five 
times  during  Phtise  Two,  and  its  studies  were  considerably  enhanced  by  presentations  and  demonstrations  provided  by 
organizations  in  the  host  countries.  The  value  of  these  contributions  to  the  Group's  work  is  gratefully  acknowledged.  It  is  hoped 
.l.ai  tils.  .scss. nd  report,  taken  together  with  the  first,  will  provide  a  valuable  source  of  information  to  a  wide  range  of  readers  in  the 
N.\T(  J  eominunit  V 
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l  a  planifictition  de  la  mission  n  est  pas  un  cone,  pt  nouveau,  et  en  ce  qui  concerne  son  application  aux  missions  de  I'aviation 
militaire  il  a  dii  etre  adopte  des  les  ongines  Tes  evenements  recents  ont  amene  un  renouveau  d'interet  pour  ee  sujet.  et  un  grand 
III  tmbre  des  h  irees  aeriennes  de  I'OT.NN  prenneni  des  dispositions  en  vue  du  dcveloppement  et  de  I'acquisition  de  sy  stemes  de 
planifieation  de  la  missii  n  ay  ant  des  eapaeites  largeinent  suptTieuresaceuxqui  sont  actuellement  disponibles.  En  meme  temps, 
un  interet  similaire  est  manifestc  pour  des  systemes  embarques  geres  par  ordinateur  pour  la  planifieation  de  la  mission  et  sa 
replanifietition  en  eours  de  vol. 

(  et  interet  s'explique  pour  diverses  raisons  el  notamment  lessor  technologique  issu  des  avancces  enregistrees  en  ce  qui 
concerne  les  ordinateurs  et  leurs  periphcTiques,  ainsi  que  les  demandes  exprimees  par  les  differentes  forces  aeriennes.  qui 
evoluent  en  fonetion  de  leur  appreciation  des  scenarios  militaires  futurs.  L’cxpcrience  acquise  recemment  lors  de  I'operation 
•'tempete  du  desert  "  suseitera,  sans  doute,  a  son  tour,  un  interet  accru  pour  des  systemes  plus  performants  de  planifieation  de  la 
missions,  y  compris  eeux  dotes  d'une  capaeite  de  repetition  de  la  mission, 

1  e  groupe  de  travail  conjoint  No.  15  de  I'ACiARD  a  etc  cree  pour  evaluer  les  systemes  de  planifieation  de  la  mission  et  pour 
apprecier  leur  evolution  future.  I.e  mandat  du  groupe  definit  un  programme  en  deux  phases  et  les  travaux  de  la  premiere  phase 
sont  deerils  dans  le  rapport  consultatif  AfiARD  No.  296  deja  paru.  Le  present  rapport  couvre  les  travaux  de  la  phase  deux.  Le 
groupe  S  CSI  reuni  cinq  fois.  el  ses  eludes  ont  tire  un  avantage  considerable  des  demonstrations  et  des  presentations  qui  ont  etc 
organisees  par  les  pays  hdtes.  I.e  groupe  tieni  a  souligner  la  valcur  de  ces  contributions  pour  ses  travaux  et  il  espcrc  que  ce 
deuxieme  rapport,  pris  ensemble  avec  le  premier,  constituera  une  source  d'informations  estimable  pour  un  tres  grand  nombre  de 
leeteurs  ile  la  communaule  de  I'GTAN. 
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Chapter  1 
Introduction 


I.I.  BACKGROUND. 

AGARD  Joint  Working  Group  15  was  authorized  in  1988  and 
commenced  work  in  February  1989.  Its  terms  of  reference 
specified  a  3 -year  period  of  studies  divided  into  two  phases. 
Phase  One  was  to  cover  an  assessment  of  the  overall  concepts  of 
Mission  Planning  and  of  the  technical  possibilities,  together 
with  the  identification  of  critical  technologies,  while  Phase  Two 
was  to  explore  in  greater  detail  these  critical  technologies  and 
their  impact  upon  future  mission  planning  systems.  The 
Working  Group  decided  during  Phase  One  that  system  tasks  and 
features  should  be  included  in  their  studies,  and  these  then 
formed  an  important  part  of  the  work  of  both  Phases  One  and 
Two. 

The  results  of  the  Phase  One  work  have  been  published  as 
AGARD  Advisory  Report  AR-296  (1.1)  and  this  second  report 
presents  the  work  of  Phase  Two.  As  the  results  of  the  Phase 
One  work  are  not  fully  repeated  here,  it  is  recommended  that  the 
reader  of  this  report  should  first  study  AR-296  which  provides 
an  essential  background.  In  addition,  because  of  the  very  lim¬ 
ited  coverage  of  in-flight  mission  planning  given  in  AR-296, 
additional  background  and  description  of  current  work  in  this 
important  area  is  given  in  Section  1.3  of  this  report. 

In  Chapter  8  of  AR-296  the  Working  Group  listed  the  topics 
which  had  been  identified  during  Phase  One  as  being  potentially 
worthy  of  furtiier  study  in  Phase  Two.  These  included  both 
system  concepts  and  system  techniques,  and  comprised 

•  Distributed  Mission  Planning  PrtKess 

•  Dynamic  Prediction  of  Battle  Evolution 

•  Interoperability 

•  Airborne  Mission  Planning 

•  Mission  Rehearsal 

■  Data  Filtering/Fusion 

•  Data  Protection 

•  Communication 

•  Testing  /  Validation 

•  Artificial  Intelligence 

•  Computer  Graphics 

•  System  Architectures 

•  Man/  System  Design 

These  topics  fn-ovided  the  start-point  for  the  Phase  Two  work 
but,  as  the  studies  developed,  it  was  found  that  further  refine¬ 
ment  was  necessary  to  reflect  changed  views  on  the  significance 
of  the  different  topics.  As  a  consequeiKe,  the  structure  of  this 
report  corresponds  only  loosely  to  the  above  topics  list. 

The  principal  objective  of  the  Phase  Two  studies  was  to  investi¬ 
gate  in  detail  the  above  topics  and  to  assess  how  these  would 
develop  in  the  future  and  how  such  developments  would  impact 
upon  future  mission  planning  systems.  An  additional  task  was 


to  recommend  any  research  and  development  programs  which 
wei,.  Identified  as  being  important  to  future  improvements  in 
mission  planning  systems.  In  carrying  out  this  work  the  effect 
of  other  influences  had  to  be  recognized;  important  amongst 
these  on  the  technical  side  is  the  enhanced  performance  and  the 
widening  role  of  avionics  equipment  on  board  military  aircraft, 
and  important  in  the  broader  military  sense  is  the  new  interna¬ 
tional  scenario  and  its  effect  upon  the  missions  likely  to  be  car 
ried  out  by  the  NATO  military  forces 

The  reader  may  wish  to  consult  other  published  papers  as  addi¬ 
tional  background,  but  there  are  few  papers  which  provide  gen¬ 
eral  descriptions  of  mission  planning  systems,  although  (1.2|  is 
useful  in  this  respect.  Most  papers  at  recent  symposia,  e.g.  ( 1 .3|. 
describe  only  the  computational  approaches  to  route  planning; 
this  represents  only  a  part  of  the  total  mission  planning  function. 
There  is  also  a  lack  of  papers  which  discuss  the  Hum.m  Factors 
aspects  of  mission  planning  and  the  problems  associated  w  ith 
the  sharing  of  tasks  between  man  and  machine,  although  11.4j 
does  acknowledge  the  joint  contribution  of  computer  and  human 
operator  to  the  total  task. 

1.2  INTRODUCTORY  DUSCT  SSION. 

1.2.1  Other  Investigations. 

Two  surveys  of  mission  planning  systems  deserve  mention.  In 
the  first  of  these.  Anacapa  Sciences  (sponsored  by  General 
Dynamics)  conducted  a  review  of  relevant  literature  in  order  ui 
compile  a  comprehensive  list  of  s(vcific  information  variables 
that  must  be  considered  during  mission  planning  11.12).  These 
variables  were  integrated  into  a  task  oriented  model  of  mission 
planning  and  reviewed  in  order  to  attain  a  pre  flight  mission 
planning  model.  At  the  highest  level.  Anacapa  identified  7 
tasks; 

1 )  assimilate  target  and  we.ipons  data 

2)  review  threat  and  weather  data  in  target  area 

3)  specify  attack  profile 

4)  optimize  flight  route 

5)  select  aircraft  configuration  and  (irocedures 

6)  review  mission  plan 

7)  transfer  system  'lata  to  aircTaft. 

Each  task  can  further  be  divided  into  subtasks.  The  Anacapa 
approach  proved  to  be  the  most  extensive  inventory  on  pre- 
flight  mission  planning  functions. 

The  second  survey  was  carried  out  by  the  NATO  Air  Force 
Armaments  Group  (NAFAG)  which  in  1990  distributed 
distributed  a  questionaire  to  collect  data  on  the  status  of  Mission 
Planning  .Systems;  19  replies  were  received  on  systems  that 
were  actually  in  use  or  were  scheduled  for  introduction  within 
the  next  few  years.  Conclusions  of  these  enquiries  that  proved 
relevant  to  this  Working  Group  are  summarized  below. 

The  NAFAG  enquiry  concentrated  on; 

1 )  supported  aircraft  tyjK-s 


2)  included  planning  furtiions 

3)  users  of  ihe  systems 

4)  system  suppliers 

5)  data  files 

6)  external  interfaces 

7)  lime  lines 

Operalional  mission  planning  systems  suppor'^-l  u  ■  '  differ¬ 
ent  fighter  aircraft  types  only.  All  mission  .lo-jiin  ■'  .ems  in 
this  inquiry  were  intended  for  use  at  or  K-iow  airbast  .-.ivel.  be  it 
by  different  actual  users: 

•  Wing  Intcllingence  Off-ccr 

•  Wing  Mission  PL-  <er 

•  Squadron  Mission  Planner 

•  Navigator  /  Observer 

■  The  pilot 

•  others  (meieo,  TAC  command,  army  liaison,  weapons 
specialist) 

•  or  a  combination  of  these. 

Some  systems  arc  interfaced  with  systems  of  a  higher  C&C 
level. 

The  NAFAG  enquiry  has  yielded  that  data  files  include  data  on 
weather,  weapons  ballistics,  aircraft  performance,  intelligence, 
threats,  terrain  elevation,  terrain  features,  electronically  slored 
maps.  Some  systems  contained  none  of  these  data:  updating  of 
datafiles  could  be  performed  manually  or  automated.  The  plan¬ 
ning  of  tactical  missions  requires  capabilites  on  route  planning, 
penetration  analysis,  and  weapon  delivery.  A'l  systems  in 
NAFAG's  enquiry  included  the  route  planning  fuc  tions  that 
were  described  as  lime  of  flight,  turn  points  and  navigational 
references:  altitudes,  fuel  consumption  and  range  calculations 
TACAN  frequencies  and  liKalions  were  included  in  most  sys 
terns.  Penetration  analysis  and  weapon  delivery  calculation 
functions  were  included  in  most  of  the  enquired  systems,  but 
some  systems  did  not  include  any  of  these  funclioas  at  all.  This 
wide  variety  in  the  capabilities  of  mission  planning  systems  is 
caused  by  the  lack  of  a  unique  definition  or  specification  of 
capabilities  that  constitute  a  mission  planning  system 

1.2J  The  Changed  Military  .Scene. 

With  five  months  to  prepare  the  first  missions  of  the  Gulf  War, 
the  air  war  went  exactly  as  planned:  pilots  had  sufficient  lime  to 
rehearse  their  first  missions  extensively  and  adapt  plans  accord¬ 
ing  to  these  rehearsal  sessions.  For  this  reason  the  lessons  of 
"Desert  Storm"  are  not  necessarily  applicable  to  other  regional 
conflicts  which  may  occur  in  the  future.  Moreover,  there  are 
differing  views  on  the  value  of  some  of  the  equipment  deployed 
in  "Desert  Storm".  For  example,  the  A-6E  SWIP  part  task 
trainer  was  extensively  utilized  by  A-6E  SWIP  squadrons  but 
published  accounts  of  its  value  range  from  "extremely  valuable” 
to  "deficient";  this  points  to  the  need  for  more  careful  analysis 
of  the  usefulness  of  such  equipment. 

"Desert  Storm"  has  also  been  the  first  example  of  a  war  of  the 
new  concept  including  the  deployment  of  forces  from  several 
NATO  nations.  The  importarKe  of  interoperability  in  the  design 


ot  mission  planning  systems  arose  during  the  conflict:  interoper¬ 
ability  experiences  have  not  been  encouraging.  For  example,  it 
required  a  Herculean  effort  to  cobble  together  a  network  that 
would  enable  US  Navy  ships  in  the  region  to  receiv  r  inlelli- 
getK'e  data  from  the  US  Air  Force. 

Pha-sc  Tw  o  of  the  Working  Group  s  studies  w  as  carried  out  dur¬ 
ing  a  period  in  which  profound  changes  were  taking  place  in  the 
international  scene.  The  most  significant  of  these  was  the  col¬ 
lapse  of  the  communist  regimes  in  Eastern  Europe  and  the  asso¬ 
ciated  break-up  of  the  military  forces  of  the  Warsaw  Pact 
During  the  same  period  occurred  the  operation  known  as 
"Desert  Storm"  in  the  Persian  Gulf  Because  of  these  the  role 
for  NATO  air  forces  of  the  future  has  been  tlie  subject  of  mtensc 
debate,  and  at  the  time  when  this  report  was  prepared  the  debate 
was  still  underway.  What  is  quite  clear  is  lhal  the  scenario  for 
which  much  previous  militarv  planning  was  aimed,  that  of  an 
intense  battle  between  NATO  and  Warsaw  Pact  forces  in 
Europe,  is  no  longer  considered  to  be  a  major  potential  threat 
situation.  Much  more  iniivulant  for  planning  purposes  are 
likely  to  be  limited  conflicts  in  regional  areas  elsewhere  w  ithin 
the  world,  although  the  potential  for  future  conriicts  within 
Eurojic  should  not  be  totally  ignored. 

In  terms  of  the  requiremems  lor  Mission  Planning  Systems, 
these  limited  regional  conflicts  may  differ  from  a  major  Euro¬ 
pean  contlict  in  several  ways,  of  which  the  most  significant  arc: 

•  1  these  regional  areas  the  databases  which  arc  at  first 
available  may  be  inadequate  for  mission  planning  and 
hence  need  rapid  upgrade,  e  c  by  the  use  of  satellite  and 
aerial  reconnaissance 

•  The  amount  of  training  and  reheais:il  done  in  tliese  areas 
may  be  zero  or  minimal 

•  Whe'e  missions  have  tended  ui  be  highly  standardi/cd, 
future  iiiissions  may  have  to  be  of  new,  unrehearsed 
types  and  m.iy  need  to  evolve  during  the  conflict  Tins, 
in  turn,  may  require  im|noved  brief  and  debrief  faciliiies 
as  well  as  mission  rehe.iis.il  capabilities 

These  changes  became  apparent  during  "Ocscrl  Slorm"  and  il 
will  be  necessary  in  pl.iiining  tor  the  future  to  take  account  of 
the  lessons  learned  in  that  oix-r.ition  As  an  example  of  this,  the 
results  achieved  by  the  AirKirne  Battlefield  Command  and 
Control  Center  Phase  III  (ABCCC  III)  systems  fitted  in  EC 
130E  aircraft  11.''!  may  be  [xiiniers  lo  the  future  in  overcoming 
the  lack  of  fixed  infraslnicture  and  the  need  for  rapid  deploy 
ment.  The  need  for  rapid  deployment  of  forces  from  several 
NATO  nations  also  points  to  the  imjxirtancc  of  interoperability 
in  the  design  of  future  mission  planning  systems. 

"Desert  .Storm"  ha.s  K-en  the  first  conflict  in  which  mission 
planning  systems  were  used  operationally.  Because  of  the  short 
preparation  time,  industries  were  unable  lo  provide  a  sufficient 
number  of  "military  hardened"  .systems,  and  "off  the  shelf 
equipment  had  to  be  used  instead.  LX'spite  the  hostile  climato¬ 
logical  environment  (i.e..  dust  and  heat),  il  proved  to  be  func¬ 
tioning  well,  however. 

I.2J  Technical  Considerations. 

The  major  technical  topics  which  were  identified  in  Phase  One 
have  been  listed  above  During  Phase  Two  these  were  amplified 
and  changed,  m  part  bccaase  of  further  technological  advances 
which  U«>k  place  and  in  part  because  of  further  studies  by  the 
Working  Group.  Tlicsc  are  rc|K)rtcd  in  later  sections  of  this  re- 


port,  bul  mention  is  made  here  of  some  specific  examples  by 
way  of  introduction. 

The  mam  technical  factor  to  note  is  the  continued  increase  in 
computer  power,  which  has  been  particularly  evident  in  com¬ 
mercial  systems  including  the  very  powerful  work  stations 
which  are  now  available.  This  makes  possible  the  development 
of  a  wide  range  of  mission  planning  systems  based  on  commer¬ 
cially  available  hardware  and  software,  from  small  portable  bat¬ 
tlefield  systems  up  to  large  systems  which  may  be  distributed 
over  several  sites  and  airtmme  platforms.  Improved  communi¬ 
cations  and  standardized  interfaces  are  essential  for  such  net¬ 
worked  systems.  In  this  area  corruncrcial  systems  are  also  pro¬ 
viding  suitable  technology,  e  g.  open  systems,  but  these  may  not 
have  adet^uate  security  for  many  military  needs. 

.Slandardi/a'ion  and  interoperability  continue  to  be  important 
considerations,  across  both  aircraft  fleets  and  ground  systems. 
IX'vcIopment  of  new  mission  planning  systems  which  are  only 
usable  with  one  specific  type  of  aircraft  is  surely  unacceptable 
in  the  future,  but  differ  i,i  ■.  ■  if  aircraft  can  have  such  differ¬ 
ent  characteristics  a-  c  .iff.  •  -  uandards  of  avionics  that  mak¬ 

ing  a  single  design  i.‘  ,  .issi'in  p  uming  system  compatible  with 
a  wide  range  of  aircr^.t  .y;vs  n.ay  be  impracticable  Difficult 
comfTonicses  will  be  necessary  ir.  this  area. 

During  Phase  One,  the 
Working  tiroup  gave 
only  limited  aitmuon  to 
airborne  mis.oon  plan 
rung  further  considera 
lion  has  been  gisen  in 
Pha.se  Two.  .ind  as  art 
irilrodus lion  to  this  a  de¬ 
scription  of  some  of  the 
current  developments  in 
i'...s  area  is  given  in 
.Seciion  1  '  of  this  repai. 

Currenl  on  board  pro 
grams  such  as  the  I'.S  .Air 
force  I'llot's  Associate' 
seem  not  to  have  giscn 
adespiate  consideration  to 
rruuhodological  compatibility  between  pre  flight  mission  plan 
Ping  and  the  mission  planning  element  within  the  on  board  sys 
tern  There  is  a  clear  need  to  consider  both  elements  in  term.s  of 
the  pilot  ta.sking  to  minimi/e  workload  and  confusion. 
Compatible  data  is  essential. 

An  alternative  typo  of  airborne  mission  planning  is  the  ABCCC 
( I  .^i'  in  which  a  planning  and  command  post  having  extensive 
computation  and  communication  capability  is  flown  in  an  air 
craft  which  is  operated  at  some  distance  from  those  aircraft 
which  arc  executing  the  operational  mission.  This  has  the  obvi 
ous  advantages  of  greater  planning  capability  and  more  crew 
availability  than  in  systems  such  as  "Pilot's  Associate  ',  against 
which  must  be  balanced  the  disadvantages  of  the  need  for  com¬ 
munications  and  the  possible  lack  of  up  to  date  local  infotma- 
t  on  which  may  be  available  to  the  operational  aircraft  through 
its  sensors. 


what  constitutes  a  Mission  Planning  System  then  becomes  rather 
blurred  and  the  simple  concept  assumed  in  Phase  One  and  de¬ 
scribed  in  AR-296  is  too  limning. 

Finally,  it  may  be  noted  that  us.ng  the  simplest  concept  of  a  mis¬ 
sion  planner  as  an  on  ground  interface  between  ground  systems 
and  the  on-board  avionics  system,  the  improved  capabilities  of 
future  avionics  systems  may  reflect  back  mto  the  specification 
of  the  mission  plaimer.  As  an  example  of  this,  more  accurate 
navigation  performance,  such  as  will  be  obtainable  from  Navstar 
GPS  systems,  may  eliminate  the  need  for  visual  waypoints 
which  in  turn  will  affect  the  route  planning  element  of  mission 
planning. 

1.2.4  tiuman  Factors  Considerations. 

It  hardly  needs  rein  '  mg  lliat  human  factors  considerations  are 
an  essential  part  of  the  design  ol  mission  plarring  systems  and 
yet,  as  was  noted  above,  there  are  tew  references  to  this  in  pub¬ 
lished  papers  This  Phase  Two  rejvrrl  examines  the  topic  m 
some  detail  in  Chapters  .f  and  -1.  .As  weli  as  the  more  detailed 
problems  of  interface  design,  the  designer  of  missior.  planning 
systems  should  also  .rd.lress  I'ue  bro.ider  problems  of  whether 
the  sy  stem  is  inlendorl  to  tv  o()orjted  by  aircrew  or  ground  .staff 
and.  m  tile  l.uiiicr  sa.sc.  whetluT  the  planning  process  i.s  also  in¬ 
tended  to  provide  the 
vrew  with  an  element  of 
briefing  for  tiie  mission 

P'gui'.'  11  liliislrales  the 
llow  of  .iformalion  be- 
tween  man  luid  machine 
and  between  on  ground 
.irid  airborne  equipment. 
The  data  flow  required  in 
the  iran.sition  between 
pre-fiighl  and  in-flight  is 
clearly  dependent  on 
whether  the  crew  has 
already  interfaced  with 
the  pre- flight  mi.ssion 
planner.  An  ideal  mis 
sion  planning  system 
would.  fK'rhaps.  generate  and  pass  to  the  avionics  system  all  the 
required  infvirmalion.  Uus  would  iinlo.id  die  planning  task  from 
the  crew  .Simil.uly  at  the  end  of  a  night,  die  information  avail¬ 
able  consists  of  that  downloaded  from  the  avionics  equipment, 
which  may  be  passed  through  the  mission  planner  for  analysis, 
together  with  that  rcmeniK’red  by  the  crew  Ideally  these  com¬ 
ponents  should  be  complimentary,  and  the  greater  the  informa¬ 
tion  which  can  Ire  output  from  the  machine,  the  less  will  be 
required  from  the  crew.  Human  Factors  considerations  of  this 
kind  suggest  that  the  design  of  a  mission  planning  system  is 
closely  related  to  die  design  of  the  .iireraft's  avionics  system  but, 
as  was  pointed  out  in  1.2,2,  this  is  not  easily  reconcilable  with 
the  concept  of  interoperability. 

IJ  IN  fli<;htmi.s.sion  planning. 


Pre-h'Li^hi  In-PUftht  Pint-Plight 


Figure  1-1.  Transfer  of  Information  Between  l^o  Flight,  In-Fliglit. 
and  Post  Flight  Phases 


For  both  the  ABCCC  and  the  "Pilot's  Associate "  the  mission 
planner  can  be  seen  as  one  element  in  a  larger  system  which  in¬ 
corporates  other  elements  carrying  out  such  furKtions  as  data  fu¬ 
sion,  command  and  control  and  communications.  In  some  cases 
these  may  be  carried  out  in  different  places.  The  definition  of 


IJ.I  Background. 

The  AR  296  Phase  One  report  covered  in  some  depth  the  cur¬ 
rent  and  emerging  ground  based  mission  planning  systems,  but 
only  briefly  mentioned  in-flight  mission  planning.  This  section 
of  the  inirodticliun  chapter  provides  further  information  on  in- 
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flight  mission  planning,  and  includes  brief  descriptions  of  re¬ 
search  programs  currently  being  undertaken  in  several  countries. 

Discussions  on  in-flight  planning  of  tactical  missions  raise 
questions  like: 

•  if  different  people  contribute  to  planning  one  mission, 
who  is  taking  account  for  which  part? 

•  a  model  to  which  an  automated  planning  system  oper¬ 
ates  should  match  as  closely  as  possible  the  pilot's  own 
cognitive  model  cf  the  planning  process,  but  what  are 
the  components  of  this  plaiming  process,  and  what's  the 
related  cognitive  model? 

•  which  part(s)  of  the  planning  process  can  be  performed 
by  a  pilot,  which  parts  require  specialist  planners,  which 
parts  can  be  automated? 

•  if  (part  of)  the  plaiming  is  automated,  how  is  it  achieved 
such  that  pilot  and/or  plaimer  have  trust  and  confidence 
in  the  results  of  this  automated  planning;  does  this  apply 
to  all  plaimed  aspects  in  a  similar  way  (i.e.  outcomes  of 
fuel  calculations  probably  need  little  discussion,  but 
what  about  advice  on  avoiding  missiles?) 

A  framework  for  answering  questions  like  these  is  needed  prior 
to  implementation  of  (sub)tasks  (sometimes  referred  to  as  "func¬ 
tions")  in  autoi  lated  systems.  The  design  and  development  of 
such  sophisticated  systems  generally  proceed  through  a  logically 
ordered  series  of  phases  each  of  which  builds  on,  and  is  much 
more  detailed  than,  its  predecessor.  For  standardization  pur¬ 
poses,  these  phases  may  be  laid  down  in  agreements.  One  ex¬ 
ample  of  such  an  agreement  is  STANAG  3994,  which  aims  at 
standardizing  methods  for  the  integ'  ition  of  human  engineering 
procedures  into  the  design  and  development  of  advanced  aircrew 
systems. 

An  example  of  drawing  such  a  framework  is  the  first  phase  in 
STANAG  3994,  "Operations  Analy  is":  "Based  on  the  predicurd 
operational  requirement,  the  system  missions  shall  be  analyzed 
to  identify  those  factors  which  dictate  tl.e  performance  require¬ 
ments  of  the  man-machine  system.  Such  factors  include  the  se¬ 
quence  and  timing  of  major  events,  threat  situations,  communi¬ 
cation,  environmental  conditions  etc." 

in  1986,  AGARD  GCP  Working  Group  7  published  ( 1.6]  an  in¬ 
ventory  of  the  tasks  and  activities  that  have  to  be  performed  by  a 
pilot  in-flight.  One  of  the  tasks  of  Working  Group  7  was  the 
"identification  of  functions  at  the  man-machine  interface  which 
are  most  promising  for  automation  and  areas  needing  additional 
research".  The  preface  of  [1.6|  states  that  "Basic  questions 
therefore  are  what  information  docs  the  pilot  really  need  and 
what  control  and  management  functions  can  be  automated  I’nd 
what  fuiKtions  must  the  pilot  retain  to  perform  his  task  satisfac¬ 
torily  in  relation  to  different  mission  aspecLs." 

In  order  to  analyze  these  tasks.  Working  Group  7  considered 
military  helicopters,  fixed  wing  air-to-air  aircraft,  fixed  wing 
air-to-ground  aircraft,  V/STOL  air-to-ground  aircraft,  and  their 
defined  operational  scenarios.  For  each,  mission  ta.sk  lists  were 
prepared.  A  large  number  of  functions  to  be  performed  within 
the  different  phases  of  the  four  examples  were  identical  or.  at 
least,  similar.  The  functions  were  grouped  into  phases; 

1)  Planning,  i.e.  basic  preparation  of  the  pilot  (briefing, 
evaluation;  planning  of  route  and  attack,  pnx;cdurcs) 

2)  preflight  activities  (inspections,  checks,  mission  data 
loading,  and  uxying) 


3)  launch  (take-off,  climb  and  cruise,  including  sensor 
activation,  setting,  monitoring  and  ch  ^king  of  systems 
and  displays) 

4)  ingress/egress 

5)  attack 

6)  recovery 

7)  post-flight  debriefings 

From  a  detailed  analysis  of  crew  tasks.  Working  Group  7  de¬ 
rived  rcconunendations  for  automation  at  the  control  and  display 
interface.  For  this  analysis  the  crew  tasks  were  grouped  into 
three  categories: 

•  control  tasks  (i.e.  flight  control) 

•  management  tasks  (i.e.  navigation,  threat  management, 
systems  management) 

•  combined  managemenl/control  tasks  (i.e.  combat  and 
weapons  management) 

In-flight  planning  is  a  management  task,  and  here  the  current 
Working  Group  15  activities  fit  into  those  of  Working  Group  7. 

The  goal  of  automation  is  to  off  load  from  the  pilot  tasks  that  he 
cannot  perform  adequately  because  of  time  consu  aints.  demands 
by  other  tasks,  the  need  to  procixss  too  much  data  or  similar  limi¬ 
tations.  A  major  risk  in  the  automation  of  military  aircraft  is 
loss  of  the  flexibility  needed  to  handle  a  rapidly  changing  tacti¬ 
cal  situation  when  automation  decisions  have  been  locked  into 
the  system  by  the  designer.  Ref.  [1.6]  proposes  to  reduce  this 
loss  in  computer-ba.scd  avionics  systems  by  providing  the  user 
with  a  choice  of  automation  categories  for  control  an^  display 
interface  automation.  Ref  (1.6j  iniicxiuces  as  automation  cate¬ 
gories  applicable  to  the  conuol  interface. 

1 )  manual 

2)  manual  augmented 

3)  manual  augmented  -  limited 

4)  cooperative 

5)  automatic  [Trc-select 

6)  ai’loniatic  select 

7)  automatic  auionomou.s 

Automation  categories  applicable  to  the  display  interface  arc; 

1)  continuous 

2)  .select 

3)  task  feedback 

4)  external  demand 

5)  system  monitoring 

Based  on  these  automation  categories  and  task  categories,  1 1 .6] 
makes  recommendations  on  categories  of  automation  for  various 
la-sk  categories.  Work  similar  to  this  has  been  carried  out  by 
Krobusek,  Boys,  and  Palko  |3.31  and  is  described  in 
Chapter  3. 

Some  of  the  conclusions  of  Working  Group  7  11.6),  may  be 
afiplicablc  to  activities  related  to  in-flight  planning. 

A  pilot's  tasks  are  separated  into; 


•  those  providing  continuous  control  over  the  aircraft 
flight  path. 

•  all  the  discrete  management  tasks 

When  the  pilot's  workload  becomes  high,  either 

•  the  flight  path  control  must  be  made  easier  to  free  a 
greater  percentage  to  the  management  task,  or 

•  the  management  tasks  must  be  reduced  in  number  or 
time  to  execute 

Functional  groups  that  seem  promising  candidates  for  automa¬ 
tion  are: 

•  various  control  tasks 

•  navigation  and  communication  (needs  to  be  expanded 
into  what  is  best  described  as  "situational  awareness"). 

132  Current  Research  Programs. 

At  present,  various  companies,  consortia  and  establishments  are 
working  on  systems  designated  to  enhance  pilot  situational 
awareness,  decrease  workload,  increase  weapon-system  effec¬ 
tiveness,  etc.,  aspects  that  have  to  be  taken  into  account  when 
addressing  in-flight  planning.  These  programs  go  by  different 
names  but  they  concern  the  concept  generally  referred  to  as 
"Pilot's  Associate".  Examples  are: 

•  the  US  "Pilot's  Associate" 

•  the  Frenrh  "Copilote  Electronique" 

•  the  British  "Mission  Management  Aid" 

All  these  programs  focus  on  sinsle-sealer  aircrafL 

The  principal  requirements  of  these  "crew  assistant"  systems  arc 
the  automation  of  routine  tasks  a:id  the  provision  of  effective 
aids  to  the  crew  in  solving  problems  and  managing  successful 
missions.  Mission  effectiveness  should  then  increase  because: 

•  the  pilot  is  freed  from  various  tasks  and  can  concentrate 
on  mission  decisions 


•  he  is  given  concise  information  relevant  to  the  mission 
witliout  saturating  him  with  data. 

The  Piloi's  As.sociaie  (PA)  prograr.i  (e.g.  ( 1 .7])  is  an  application 
of  the  Defense  Advanced  Research  Project  Agency's  (DARPA) 
Strategic  Computing  Initiative.  The  initiative  has  as  its  goal  the 
exploitation  of  new  computing  technologies  such  as  Artificial 
Intelligence  in  general,  knowledge-based  /  expert  systems  in 
particular,  parallel  processing  architectures  and  speech  systems. 
The  PA  program  focuses  on  as.sisiing  pilots  of  single  seat  fighter 
aircraft  (see  Figure  1-2)  and  is  plarmed  as  a  high-risk,  high-pay- 
off  effort  that  is  not  aimed  at  a  specific  flight  vehicle  applica¬ 
tion.  The  first  phase  of  the  program,  .System  Development, 
focused  on  the  technological  development  of  a  system  capable 
of  performing  a  set  of  functions  that  will  assist  pilots  in  operat¬ 
ing  aircraft  and  performing  their  combat  mission. 

Two  contracts  were  awarded  in  1986  for  a  three  year  "Phase 
One"  development.  One  focused  on  air-to-ground  scenarios  and 
platforms  and  was  lead  by  a  learn  directed  by  McDonnell  Air¬ 
craft  Company.  The  second  program  focused  on  air-to-air  mis¬ 
sions  and  was  headed  by  a  team  from  Lockheed  Aeronautical 
Systems  Company. 

Phase  One  of  both  programs  was  conducted  in  several  stages, 
each  with  appropriate  demonstrations,  leading  up  to  Demo  3  in 
1990.  At  this  point  the  systems  contained  the  functional  proto¬ 
type  capability  envisioned  for  ihe  Pilot's  Associate,  using  near- 
term  computing  hardware  applied  to  a  model  of  a  planned  ser¬ 
vice  aircraft.  However  the  Demo  3  prototype  still  lacked  the 
knowledge  depth  required  for  full  functioning,  and  did  not  oper¬ 
ate  in  real  time. 

The  mission  planner  contained  within  the  Lockheed  Demo  3 
system  was  implemented  in  C  and  hosted  on  a  Sun  Workstation. 
The  route  planning  function  included  three  linear  dimensions 
but  the  time  dimension  was  not  implemented.  The  heuristically- 
controllcd  mission  planner  used  the  route  planner  to  supply 
routes  from  which  the  pilot  could  make  his  selection. 

Phase  2  of  the  Pilot's  Associate  program  has  now  commenced 
with  the  aim  of  demonstrating  a  fully-funciional  system  execut¬ 
ing  in  a  real-time,  man-in-the-loop  envirotunent;  this  should  be 


PILOT’S  ASSOCIATE 


Figure  1-2.  Block  Diagram  of  the  Pilot's  Associate  Architecture. 
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completed  in  1992. 

The  Cooilote  Electionioue  is  an  ambitious  project,  initiated  in 
1986  by  the  Direction  des  Recherches,  Etudes  et  Techniques 
and  Dassault-Avialion.  which  aims  to  use  Artificial  Intelligence 
techniques  to  create  an  embedded  system  for  decision  aid  in  a 
single-seater  fighter  aircraft  [1.8],  The  objective  is  to  provide 
the  pilot  with  relevant  information  for  decision  aiding  and  so  to 
enhance  the  global  effectiveness  of  the  mission. 

The  Copilote  Electronique  has  to  meet  various  constraints: 

•  it  has  to  be  able  to  deal  with  data  that  may  be  uncertain, 
incomplete  or  non-existing 

•  it  has  to  take  into  account  that  data  may  arrive  in  an 
asynchronous  sequence:  lower  priority  activities  have  to 
be  interrupted  if  new  data  referring  to  a  higher-priority 
process  arrive 

•  the  Copilo'.e  Electronique  has  to  guarantee  the  best  pos¬ 
sible  answer  to  a  problem  in  time:  it  is  better  to  have  a 
crude  and  incomplete  solution  in  time  than  one  that  is 
detailed  and  fully  elaborated  but  too  late. 

The  concept  of  the  Copilote  Electronique  distinguishes  a  hierar¬ 
chy  of  reasoning  levels.  The  reasoning  level  is  decomposed  into 
a  reflection  level  ("niveau  de  reflection")  and  a  decision  level 
("niveau  decision")  (see  Figure  1  -?).  At  the  reflection  level,  the 
available  data  are  manipulated.  At  the  decision  level,  inientions 
are  translated  into  considered  actions  or  propositions  for  actions, 
and  interactions  with  the  pilot  and  the  system  take  place.  From 
bottom  to  top,  the  following  levels  can  be  distinguished: 

•  data  (on  resources,  on  systems,  on  the  environment, 
from  sensors,  calculators,  mass  memory) 

•  reflection:  evaluation  of  tactical  situation  and  of  mission 
plans,  including  pilot  behavior  ("comportement  pilote") 

•  decision  making  (various  management  activities:  system 
management,  tactical  management,  mission  manage¬ 
ment,  and  information  management) 


•  Man-Machine  Interface  (.MMl) 

Major  concepts  (navigation  &  attack  system,  operational  con¬ 
cept,  nature  of  data)  are  aimed  at  implementation  in  the  Rafale 
D  aircraft.  The  model  of  the  Copilote  Electronique  is  at  present 
being  developed  at  Dassault-Aviaiion  by  interacting  with  an 
operational  simulation. 

Both  DARPA’s  Pilot's  Associate  and  Copilote  Electronique  use 
more  or  less  the  same  modules;  a  major  difference  is  the  distinct 
hierarchy  used  in  the  Copilote  Electronique. 

The  Mission  Management  Aid  (MMA)  Project  is  a  collaborative 
research  project  between  British  Aerospace.  GEC  Ferranti 
Defense  Systems.  GEC  Avionics  &  GEC  Sensors,  Smiths 
Industries  Aerospace  and  Defense  Systems  and  the  Defence 
Research  Agency.  The  four  compames  have  worked  together  as 
the  Industrial  Avionics  Working  Group  since  it  was  formed  in 
1979.  This  group  has  for  an  extended  period  been  working  on 
the  definition  and  high  level  design  of  a  unified  concept  for 
advanced  automation  within  an  integrated  avionics  system 
known  as  the  Mission  Management  Aid  or  MMA  [1.9,  1.10). 
The  objectives  of  the  Project  Program  are: 

1)  to  establish  the  functional  requirement;  and  fea.sibility 
of  .systems  such  as  the  MMA 

2)  to  prove  the  techniques  for  accomplishing  this  in  a 
rapid  prototyping  envnonment  and  produce  a  set  of 
functional  specifications 

i)  to  optimi/'e  the  MMA  functionality  .uid  develop  the 
MMl  on  a  real-time  Mission  Capable  Simulation  (sec 
Figure  1-4). 

The  MMA  incorjxirates  die  (oliowmg  major  functional  areas 

•  Sensor  Fusion 

•  Situation  Assessment 

•  Dynamic  Planning 

•  Man  Machine  Interface 
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Figure  1-3.  Block  Diagram  of  the  CoPilnt  Electronique  Architecture. 
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MISSION  MANAGEMENT  AID 


In  the  MMA  concept.  Sensor  Fusion  takes  data  from  a  number 
of  sources  including  the  on-board  tactical  database  and  com¬ 
bines  it  to  produce  a  single  fused  view  of  the  outside  world  re¬ 
ferred  to  as  the  "Alpha  Scene".  This  is  combined  with  intelli¬ 
gence  data  from  the  pre-mission  brief  database  to  produce  an  as¬ 
sessed  view  of  the  situation  (referred  to  as  the  "Beta  scene"), 
taking  account  of  the  objectives  of  the  current  and  future  mis 
sion  phases.  This  assessed  view  and  the  overall  mission  objec¬ 
tives  are  used  to  produce  a  number  of  tactical  options  (referred 
to  as  "Gammas").  Finally,  the  MMI  function  prioritizes  the  in¬ 
formation  presented  to  the  pilot  and  manages  the  displays  and 
multi- function  controls. 

Alter  consideration  of  a  number  of  possible  missions  and  sce¬ 
narios  It  was  decided  that  to  most  fully  exercise  MMA  s  func 
tionality  the  initial  prototype  should  operate  in  an  air  to  ground 
role,  although  the  capability  to  carry  out  air  to  air  missions  will 
be  incorporated  in  a  later  phase. 

In  endeavoring  to  define  the  allixiation  of  function  between  man 
and  machine  it  is  important  to  develop  an  understanding  of  the 
capabilities  of  future  systems:  it  is  necessary  to  consider  which 
tasks  are  best  suited  to  the  MMA  and  which  to  the  pilot,  how  the 
allcKation  of  authority  for  these  may  be  influenced  by  the  opera 
tional  amtext  and  the  need  for  duplication  of  function  between 
the  pilot  and  the  MMA.  Human  performance  is  modeled  on  the 
basis  of  different  levels  of  activity  or  re.spsrase: 

•  skills 

•  knowledge 

•  inference 

-Skills  arc  developed  through  extensive  training  and  practice 
(e  g.  flight  control,  weapon  aiming).  Skills  arc  su.sceptiblc  to 
disruption  from  competing  tasks  which  may  unexpectedly  as 
sumc  a  higher  priority.  Unlike  the  machine,  the  human  operator 
is  very  poor  at  multiplexing  Ixetwccn  tasks.  Machines  can  per 
form  these  tasks  with  an  accuracy  which  is  only  effectively  lim 
ited  by  the  resolution  of  the  sensor  data  power/speed  of  the  pro¬ 
cessor,  etc.  An  example  of  activity  that  is  based  on  knowledge 


or  previous  experience  is  the  response  to  threats.  Humans  are 
generally  good  at  this  activity  while  machine  perfoimancc,  on 
the  other  hand,  is  usually  adversely  affected  with  increasing 
data.  Infercncing  is  the  ability  to  reach  a  decision  or  to  take  a 
course  of  action  based  on  incomplete  data,  and  requires  some 
level  of  reasoning  or  projection  about  possible  outcomes  or  al¬ 
ternative  solutions.  Humans  are  p.inicularly  good  at  this  activ- 
ity. 

Tlie  techniques  required  by  the  core  functions  of  the  MMA  are 
currently  under  development  in  the  prolotyjiing  phase.  The 
MMA  Project  will  est-iolisli  a  flexible  real-time  Mission 
Capable  -Simulator  embodying  die  MMA.  The  objectives  of  this 
simulation  facility  are  lo  allow  the  objective  optimization  of  the 
MM.A/MMI  prototype  functions  in  a  realistic  environment  and 
to  investigate  the  relative  efficiencies  of  various  methods  of  in¬ 
formation  preseiilJlion  and  jiilot  interactions  with  the  system. 

All  three  research  programs  sli.ire  the  philosophy  that,  in  the  fu¬ 
ture.  machines  will  carry  out  routine  tasks  and  compute  tactics, 
relieving  pilots  lo  concentrate  on  the  higher  level  tasks  they  arc 
better  qualified  and  trained  lo  do.  A  pilot's  role  on  the  aircraft 
will  change  from  that  of  an  operator  to  that  of  a  manager.  Each 
program,  however,  defines  its  own  "nnxlules",  "core  functions  ", 
"decision  levels  ".  "levels  of  task  abstraction  ",  or  "functional  ar¬ 
eas"  etc.,  making  it  difficult  lo  compare  and  to  match  them  mu¬ 
tually. 

In  the  end,  die  crew  assistiuit  coriceiit  should  provide  the  frame¬ 
work  for  pre-flight  as  well  as  in  flight  planning  activities. 
Major  differences  between  j’re  flight  and  in-flight  arc  that 
system  status  activities  are  not  required  pre  fiight.  and  that  pre- 
flight  activities  -are  less  time  critical. 

1.4  REPORT  OIMECTIVKS  AND  FORMAT. 

As  noted  above,  this  rejxirl  describes  the  results  of  the  work  car 
ried  out  by  the  Working  Group  during  Phase  Two  of  their  stud¬ 
ies.  It  is  hoped  that  it  will  be  useful  to  a  wide  range  of  readers 
in  the  NATO  eommiinity,  including  fHitenlial  users  of  mission 
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planning  systems  as  well  as  those  engaged  in  research  and  de¬ 
velopment. 

As  will  be  clear  from  the  text  which  follows,  future  develop¬ 
ments  in  the  field  of  mission  plarming  systems  could  take  place 
in  many  different  ways,  depending  upon  both  technical  devel¬ 
opments  and  the  future  needs  of  the  NATO  air  forces.  Because 
of  this  wide  range  of  possibilities,  and  the  way  in  which  the  var¬ 
ious  technologies  and  requirements  interact  together,  it  has  not 
been  possible  to  produce  a  report  which  shows  a  logical  series 
of  developments  culminating  in  a  design  appropriate  for  some 
future  application.  Neither  has  it  been  possible  to  make  a  logical 
separation  between  System  Concepts  and  System  Techniques  as 
was  attempted  in  Chapter  8  of  AR-296.  Thus  the  techniques  and 
the  systems  descriptions  which  follow  have  been  grouped  into 
chapters  in  as  orderly  a  way  as  possible,  which  it  is  hoped  will 
enable  the  reader  to  gather  together  the  information  most  appro¬ 
priate  to  his  own  problem  or  his  own  area  of  technical  interest. 


Following  this  introduction.  Chapter  2  describes  some  of  the 
wider  issues  involved  in  the  overall  design  of  mission  plarming 
systems.  Chapter  3  deals  with  the  vital  subject  of  Human 
Factors  and  leads  into  Chapter  4  which  is  concerned  with  the 
new  technologies  in  the  man/machine  interface  area. 

The  various  emergittg  technologies  in  the  field  of  computation 
are  described  in  Chapter  5.  and  some  important  areas  in  which 
compulation  is  applied  in  mission  planning  systems  are  the 
subject  of  Chapter  6.  Chapter  7  covers  a  very  important  but 
much  neglected  subject,  that  of  evaluating  mission  plarming  sys¬ 
tems.  Chapter  8  summarises  the  principal  conclusiotrs  of  the 
Working  Group’s  studies  and  identifies  research  and  develop¬ 
ment  topics  which  could  be  imptrriant  for  future  mission  plan¬ 
ning  systems. 


Chapter  2 

System  Design  Issues 
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2.1  INTRODUCTION. 

In  this  Chapter  we  discuss  mission  plamiing  system  design 
issues  that  were  identified  during  Phase  Two  of  the  Working 
Group  as  either  major  factors  in  mission  planning  system  per¬ 
formance  or  as  critical  areas  for  ongoing  research.  We  begin 
where  the  Phase  One  report  left  off  by  focusing  on  ground-based 
mission  planning  systems  used  by  the  pilot  to  plan  the  mission. 
Later  we  expand  into  what  we  believe  to  be  the  future  growth 
areas  of  mission  planning  systems.  These  future  areas  include; 

1)  integrating  ground-based  mission  planning  systems 
into  networks  that  can  perform  mission  planning  at 
higher  levels  in  the  chain-of-command  (e.g.,  squadron 
level  or  wing  level). 

2)  fully  integrating  ground-based  mission  planning  sys¬ 
tems  into  C^I  networks  so  that  they  may  fully  exploit 
the  latest  real-time  information  concerning  the  battle¬ 
field  situation. 

3)  moving  towards  greater  amounts  of  automation  in  the 
mission  planning  process  itself,  where  the  mission 
planner  is  able  to  perform  more  sophisticated  planning 
functions  that  currently  are  performed  by  the  human 
planner. 

4)  moving  automated  mission  planning  technologies  from 
the  ground  into  the  aircraft. 

5)  applying  mission  planning  technologies  to  the  growing 
field  of  Remotely  Piloted  Vehicles  (RPVs),  Unmatuied 
Air  Vehicles  (UAVs).  and  Smart  Weapons. 

In  the  remainder  of  this  Section,  we  will  discuss  the  critical 
system  design  issues  associated  with  these  five  areas. 

During  the  Phase  One  activity  the  Working  Group  identified  9 
design  characteristics  that  were  important  to  consider  when  de¬ 
veloping  and  evaluating  a  ground-based  mission  planning 
system.  These  characteristics  are: 

(1)  Interoperability 

(2)  Database 

(3)  Communication 

(4)  Time 

(5)  Flexibility 

(6)  Ergonomics 

(7)  Deconfiiction 

(8)  Mission  Rehearsal 

(9)  Growth  Potential 

For  Phase  Two  it  was  considered  apinopriate  to  reorient  the  dis¬ 
cussion  and  concentrate  more  fully  on  the  architecture  of  mis¬ 
sion  planning  systems.  Therefore,  although  these  characteristics 
are  still  of  vital  importance,  they  will  not  be  discussed  as  sepa¬ 
rate  topics  in  this  report,  but  addressed  in  the  context  of  the  five 
application  areas  of  mission  plarming  systems  that  were  defined 
above.  Many  of  these  issued  are  stressed  in  other  Chapters 
throughout  the  remainder  of  the  report. 


2  J  GROUND-BASED  MISSION  PLANNING  SYSTEMS. 

2.2.1  Functional  Description. 

In  functional  terms,  a  ground-based  mission  planning  system  is 
a  system  that  allows  all  the  available  and  pertinent  information 
to  be  used  to  plan  a  mission  to  achieve  certain  objectives  in  an 
optimum  or  near-optimum  way,  and  also  allows  data  that 
describes  the  mission  to  be  loaded  into  the  aircraft.  The  earliest 
systems,  and  even  some  of  those  in  use  today,  are  no  more  than 
an  assembly  of  printed  data  (maps,  manuals,  intelligence 
reports,  etc.)  together  with  a  simple  manually  operated  calcula¬ 
tor  that  allows  routes  to  be  planned.  These  have  evolved  into 
the  more  modem  equivalent  that  comprises  a  computer  with  var¬ 
ious  input/output  channels  and  a  range  of  peripherals  such  as 
displays. 

The  inputs  to  the  mission  planning  system  comprise  data  arriv¬ 
ing  via  communication  nets  to  which  the  system  is  coupled. 
Some  of  the  data  may  be  entered  manually  but  it  is  anticipated 
that,  increasingly,  data  will  be  in  a  form  that  can  be  directly 
input  into  the  mission  planning  system  computer.  The  principal 
output  is  the  mission  data  to  be  loaded  into  the  aircraft  via  cas¬ 
settes  or  similar  devices,  or  carried  aboard  by  the  aircrew  in 
paper  form.  As  mission  planning  systems  become  linked  into 
networks,  distributing  mission  data  via  the  network  will  become 
an  important  requirement. 

The  interface  with  the  operator  is  provided  by  various  pointing 
devices,  i.e.,  the  mouse,  trackball,  digitizing  puck,  keyboard, 
and  display.  The  keyboard  is  fairly  typical  and  the  display  is 
now  usually  full  color  and  of  a  higher  resolution  than  provided 
in  many  workstations. 

The  use  of  Ground-Based  mission  planning  systems  by  NATO 
countries  has  proceeded  rapidly  since  the  inception  of  the 
Working  Group.  However,  it  is  important  to  note  that  these 
mission  planning  systems  serve  largely  as  a  calculator  and  dis¬ 
play  device  for  the  human  planner.  Other  than  a  small  number 
of  systems  that  have  a  limited  auto-route  generation  capability, 
there  is  very  little  in  the  way  of  automation.  The  generation  of 
the  plan  itself  is  left  to  the  human  planner. 

2.2.2  Ground-Based  Planning  Hardware. 

The  major  hardware  components  of  a  ground-based  mission 
planning  system  arc: 

•  The  Processor 

•  Memory  Devices 

•  Color  Displays 

•  Input  Devices  (mouse,  keyboard,  etc.) 

•  Output  devices  (printer,  cartridge  tape) 

The  capabilities  of  these  components  when  integrated  into  a 
mission  planning  system  arc,  for  the  most  pan,  quite  sufficient 
to  meet  performance  requirements.  In  some  cases  the  memory 
available  may  be  insufficient  to  store  the  large  amounts  of  ter 
rain  and  imagery  data  used  in  the  mission  planning  process. 
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however,  the  continued  advances  in  the  areas  of  optical  storage 
devices  is  expected  to  largely  address  this  shortfall,  and  there¬ 
fore  significant  research  by  the  mission  planning  community  is 
not  seen  as  necessary. 

One  area  of  concern  is  that  of  color  displays.  Currently  the 
resolution  of  color  displays  is  not  equal  to  that  available  from 
papo'  map  products.  This  performance  limitation  will  continue 
to  limit  automated  mission  plaiming  systems  in  that  mission 
plaimers  will  never  completely  forsake  the  paper  world  so  long 
as  they  provide  the  better  visual  resolution.  Displays  are 
therefore  discussed  in  greater  detail  in  Chapter  4  where  we 
discuss  the  Man/Machine  Interface  Technologies. 

The  most  important  aspect  of  trends  in  the  area  of  mission 
planning  system  hardware  does  not  concern  required  technical 
break  through.  Rather  it  concerns  the  ability  to  acquire  the  most 
capable  hardware  quickly  and  affordably.  In  the  past,  military 
organizations  have  tended  to  develop  and  procure  their  weapons 
systems  using  a  process  separate  from  the  commercial  world. 
Mission  planning  systems  have  been  no  different.  The  reasons 
for  this  separation  were  many,  but  unfortunately  the  benefits 
associated  with  military  standard  hardware  came  at  a  high  cost. 

In  no  area  was  this  cost  more  obvious  than  in  the  procurement  of 
military  computer  systems.  The  long  design  cycle  associated 
with  military  systems  (as  high  as  10-12  years)  not  only  resulted 
in  high  costs,  but  also  virtually  guaranteed  that  a  military  com¬ 
puter  system  would  be  obsolete  before  it  was  even  finished 
being  developed.  This  situation,  coupled  with  the  explosive 
growth  in  Jic  capabilities  and  low  costs  of  commercial  computer 
systems  has  started  a  trend  by  the  services  toward  the  use  of 
commercially  procured  computer  systems  to  support  a  wide 
variety  of  military  applications.  This  trend  will  be  especially 
true  for  mission  planning  systems.  As  reported  in  Aviation 
Week  &  Space  Magazine 

".  .  .Lt.  Col.  Tony  Sharon,  chief  of  the  mission  planning 
division  at  ESD  (the  US  Air  Force's  Electomic  Systems 
Divsion,]  said  the  Air  Force's  strategy  is  to  spend  funds 
to  create  standardized  software  rather  than  develop  cus¬ 
tomized  computer  hardware.  .  .  .”  [Aviation  Week  and 
Space  Technology,  June  10,  1991  Vol.  134,  #23,  p.  52.) 

In  fact,  the  trend  towards  the  use  of  commercial  hardware  for 
mission  plaiming  systems  is  already  underway.  A  large  number 
of  the  currently  fielded  mission  plaiming  systems  are  built 
arouitd  commercially  available  computer  systems  (see  Phase 
One  Report  Appendix  A.)  Indeed,  mission  planning  systems 
were  instrumental  as  an  early  user  of  commercial  hardware,  in 
identifying  the  benefits  to  be  gained  from  the  use  of  commercial 
hardware. 

The  major  conclusion  to  be  gained  from  looking  at  the  hardware 
requirements  associated  with  current  ground-based  mission 
planning  systems  is  that: 

*  for  the  most  part  they  will  be  addressed  by  the  normal 
development  processes  taking  place  in  the  commercial 
world 

*  The  trend  towards  using  commercially  available  hard¬ 
ware  will  help  address  key  issues  such  as  interoperabil¬ 
ity,  expandability,  and  modularity,  as  the  commercial 
world  has  already  taken  major  steps  towards  achieving 
greater  hardware  interoperability. 

*  special  attention  may  need  to  be  given  to  the  areas  of 
display  resolution  and  printer  resolution. 


•  In  the  future,  as  more  and  more  of  the  planning  tasks  are 
automated,  parallel  processing  architectures  will  become 
important  to  help  mission  planning  systems  meet  their 
real-time  computational  requirements. 

2.2J  Ground-Based  Planning  Software. 

While  the  prognosis  for  mission  planning  system  design  issues 
concerning  hardware  is  quite  positive,  the  situation  for  design 
issues  concerning  software  is  more  critical.  It  is  clear  that  the 
trend  in  the  hardware  area  is  toward  commercial  standards  that 
should  go  a  long  way  towards  addressing  the  key  concerns  of 
modularity,  interoperability,  interfaces,  and  expandability. 

The  corresponding  trend  does  not  exist  in  the  area  of  software, 
for  although  the  military  can  share  computer  hardware  with  its 
civilian  counterparts,  the  software  requirements  for  mission 
planning  are  quite  unique.  Therefore,  it  is  to  the  software  arena 
that  much  of  the  research  in  the  mission  planning  field  must  be 
addressed.  It  should  be  noted,  of  course,  that  these  problems 
with  software  are  not  unique  to  mission  plarming. 

2.2.3. 1  Software  Architecture 

An  over-riding  problem  in  the  software  area  is  the  lack  of  stan¬ 
dards  which  also  appears  to  be  occurring  in  the  hardware  area. 
The  result  is  a  tremendous  number  of  stand-alone  mission  plan¬ 
ning  systems  that  can  only  be  used  for  the  specific  aircraft  for 
which  they  were  developed.  A  major  design  issue  for  future 
mission  planning  systems  will  be  to  develop  software  architec¬ 
ture  that  separates  the  aircraft  specific  software  from  tne 
aircraft-independent  software.  The  aircraft-independent  soft¬ 
ware  can  then  be  dcvcltiped  and  maintained  to  support  the  com¬ 
plete  spectrum  of  applications  saving  significant  time  and 
money.  Some  examples  of  aircraft-independent  software 
include: 

•  User  Interface  Software  for  entering  data  (c.g..  way¬ 
points,  navigation  points,  timc-on-target.  etc.)  and  for 
displaying  data  (e  g.,  maps,  imagery,  etc.) 

•  Threat  computation  models. 

•  Weather  prediction  models. 

A  major  research  objective  for  mission  planning  software  will 
be  to  develop  a  mission  planning  software  architecture  that  pro¬ 
vides  a  common  user  interface  and  a  coiiunon  set  of  computa¬ 
tional  tools  that  can  interface  with  aircraft  specific  software  and 
models.  Of  particular  value  would  be  a  design  which  enables  an 
aircraft  model  of  flight  performance  and  weapon  data  to  be 
plugged  into  a  generic  mission  plani.uig  system  in  much  the  way 
that  software  libraries  are  used  today  in  programming.  Work  is 
already  beginning  in  this  area  by  the  US  Air  Force  (AFMSS) 
and  the  US  Navy  (TAMPS) 

2.2  3.2  Software  Standard.^ 

To  support  the  development  of  a  modular  mission  planning 
system  software  architecture  it  is  becoming  increasingly  clear 
that  software  stanu.  'ds  need  in  be  adopted.  A  current  trend  in 
the  commercial  world  is  towards  the  adoptation  of  the  UNIX 
operating  system  coupled  with  X-Windows  as  the  user  interface 
software.  Although  there  are  other  competing  standards, 
UNIX/X -Windows  appears  to  have  the  upper  hand  as  of  this 
moment. 

UNIX  and  X-Windows  (or  some  alternatively  accepted  stan¬ 
dard)  offer  the  potential  to  meet  the  modularity,  interoperability. 
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interface,  and  expandability  requirements  of  future  mission 
planning  systents.  In  fact,  several  of  the  NATO  countries  are 
already  looking  towards  the  UNIX/X-Windows  standard  as  the 
development  environment  for  their  next  generation  of  work 
station-based  applications.  Again  as  reported  in  Aviation  Week 
&  Space  Technology,  Lt.  Col.  Tony  Sharon  indicated  that  for 
future  US  Air  Force  mission  planning  systems 

"...  The  new  mission  plarming  system  will  employ  an 
open  computer  architecture  based  on  industry  standards 
such  as  X-windows  and  POSIX.  This  will  make  it  pos¬ 
sible  to  select  a  wide  variety  of  engineering  work  sta¬ 
tions  to  meet  current  and  future  needs  for  mission  plan¬ 
ning  consoles.  .  ."  [Aviation  Week  and  Space  Tech¬ 
nology,  June  10, 1991  Vol.  134,  #23,  p.  52.] 

Despite  the  emergence  of  a  possible  software  development  envi¬ 
ronment  standard,  there  are  still  many  different  software  1c.  cl 
opment  environments  used  throughout  the  NATO  countries. 

The  development  of  software  standards  and  so  called  "re.useable 
software”  to  avoid  costly  duplication  of  effort  is,  of  course,  a 
problem  that  spans  the  entire  software  development  community, 
of  which  mission  plarming  is  but  a  small  part  It  will  be  impor¬ 
tant  for  mission  plarming  software  developers  to  keep  abreast  of 
the  latest  advances  in  this  area.  In  addition,  it  is  important  to 
keep  in  mind  that  although  software  standards  may  be  emerging 
in  the  commercial  world,  it  is  largely  a  political  question  as  to 
whether  NATO  countries  agree  to  bind  themselves  to  an 
accepted  standard.  In  this  time  of  reduced  tensions,  it  may  be 
more  difficult  to  achieve  this  objective. 

NETWORKING  MISSION  PLANNING  SYSTEMS. 

The  capabilities  of  current  mission  plarming  system  are  primar¬ 
ily  limited  to  plarming  the  mission  of  a  single  aircraft.  A  major 
requirement  for  future  mission  planning  systems  will  be  to  ex¬ 
pand  their  capability  to  perform  multi-aircraft  plarming  and  to 
integrate  better  into  the  C^I  network. 

Advances  in  multi-aircraft  plarming  by  networking  mission 
plarming  systems  together  offers  the  opportunity  to  address 
critical  deficiencies  in  current  mission  plarming  system  capabili¬ 
ties,  particularly  in  the  area  of  deconfliction,  and  battle-field  co¬ 
ordination.  The  continued  progress  to  integrate  mission  plan¬ 
ning  systems  into  the  C^l  network  will  further  enhance  the 
capabilities  of  mission  plarming  technology  by  reducing  the  time 
that  the  plarmer  must  spend  entering  data  into  the  system  and 
increasing  the  time  available  to  plan  the  mission. 

A  major  obstacle  to  this  integration  will  be  the  issue  of  security 
and  communication.  Linking  mission  plarming  systems  that 
reside  in  the  field,  with  highly  sensitive  national  intelligence 
databases  will  require  significant  advances  in  computer  security. 
Even  if  the  security  issue  can  be  overcome,  communication  will 
present  significant  problems  in  that  the  volume  of  data  desired 
to  support  mission  planning  may  stress  the  bandwidth  of 
operational  communication  systems. 

The  Working  Group  recognized  developments  in  this  area  to  be 
important  for  future  research.  However,  because  the  Working 
Group  lacked  extensive  expertise  in  this  area,  we  have  few 
specific  recommendations  to  convey. 


2.4  FULLY  AUTOMATED  MISSION  PLANNING. 

The  transition  of  the  mission  planning  function  from  the  ground, 
where  it  is  a  pre-mission  activity,  to  the  air.  where  it  is  an  inte¬ 
gral  part  of  performing  the  mission,  brings  a  whole  host  of  new 
issues  that  must  be  considered. 

2.4.1  The  Mission  Planning  Problem. 

Mission  planning  problems  are  complex  and  difficult  for  a  vari¬ 
ety  of  reasons.  First,  multiple  (and  often  conflicting)  objectives 
must  be  pursued  in  the  face  of  a  variety  of  both  impbeit  and 
explicit  constraints.  Represenlalive  mission  objectives  include 
reconnaissance,  re-supply,  support  and  strike.  Implicit  con¬ 
straints  are  constraints  that  are  imposed  by  the  vehicle  design 
(e.g.,  its  fuel  carrying  capacity,  stores  carrying  capacity,  perfor¬ 
mance  envelope  and  subsystem  capabilities).  Explicit  con¬ 
straints  are  constraints  that  may  be  imposed  by  a  higher  plan¬ 
ning  authority  (e.g.,  a  requued  probability  of  survival  or  mission 
success,  time  or  ordering  constraints  that  may  be  imposed  on  the 
pursuit  of  specific  mission  objectives,  navigation  constraints, 
maneuvering  constraints  within  the  vehicle's  performance  enve¬ 
lope  and  constraints  imposed  by  the  time  available  to  plan).  The 
fact  that  planning  must  account  for  significant  uncertainty  in  the 
plarmer's  knowledge  of  the  current  and  future  “state  of  the 
world”  (i.e..  the  state  of  the  vehicle  and  its  environment)  also 
contributes  to  the  complexity  and  difficulty  of  the  mission  and 
trajectory  planning  problem.  Because  of  this  uncertainty,  the 
formulation  of  detailed  plans  too  far  into  the  future  is  generally 
a  futile  exercise.  As  a  consequence,  an  onboard  capability  to 
replan  the  mission  is  essential  for  piloted  as  well  as  autcromons 
vehicle  applications,  especially  in  jxiorly  characterized  envi- 
rorunenls  where  long  endurance  is  required. 

The  requirement  to  replan  the  mission  in  real  time  adds  yet 
another  layer  of  complexity  and  difficulty  to  the  mission  and 
trajectory  planning  problem.  This  requirement  arises  not  only 
because  of  the  uncertainty  with  respect  to  the  current  and  future 
state  of  the  world  that  inevitably  prevails  at  the  time  the  mission 
is  originally  planned,  but  also  because  of  unforeseen  conlingen- 
ctes  requiring  a  response  in  real  time  that  arise  during  the  exe¬ 
cution  of  the  mission  For  example,  a  higher  planning  authority 
may  redefine  the  mission  objectives  or  alter  the  constraints  that 
arc  imposed  on  the  pursuit  of  those  objectives,  the  mission  envi¬ 
ronment  (threats,  weather,  etc.)  might  change,  the  vehicle  might 
sustain  failures  or  damage,  or  opportunities  to  accomplish  addi¬ 
tional  objectives  might  ix'cur. 

2.4.2  Hierarchical  Decomposition. 

Within  a  mission  planning  system,  the  level  of  detail  to  which 
mission  activities  must  be  planned  by  a  given  planning  algo¬ 
rithm  is  determined  by  spatial  and  temporal  plarming  horizons. 
Over  a  short  planning  horizon,  actions  must  be  plarmed  in  great 
detail.  In  contrast,  it  is  unnecessary,  even  futile,  to  plan  actions 
that  lie  beyond  a  short  planning  horizon  at  the  same  high  level 
of  detail.  Thus,  there  is  a  natural  decomposition  of  the  in-flight 
mission  plarming  function  into  a  hierarchy,  wherein  the  plarming 
horizon  decreases  and  the  level  of  detail  at  which  actions  are 
plarmed  increases  as  one  moves  from  higher  to  lower  levels  of 
the  hierarchy.  In  the  context  of  an  aircraft  mission  planning 
problem,  skeletal  plans  of  the  entire  mission  are  constructed  at 
the  highest  level  of  the  hierarchy.  At  intermediate  levels,  near- 
term  actions  that  are  consistent  with  the  mission  flight  plan  are 
planned  in  greater  detail.  Finally,  at  the  lowest  level  of  the  hier¬ 
archy.  commands  are  generated  for  vehicle  subsystems  (e.g.. 
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seniors,  vehicle  propulsion  and  control  systems)  that  execute  the 
mission  and  ensure  vehicle  safety. 

The  hierarchical  approach  to  decision-making  decomposes  a 
large  problem  into  a  number  of  separate  levels  or  sub-problems, 
thereby  reducing  the  overall  complexity,  ideally  without  com¬ 
promising  overall  system  performance.  At  the  top  level  of  the 
hierarchy  the  entire  mission  is  planned  using  coarse  (e.g., 
abstract)  models.  As  one  progresses  downward  in  the  hierarchy, 
the  spatial  and  temporal  scope  of  the  decision-making  functions 
decrease  and  the  level  of  modeling  detail  increases.  The  parti¬ 
tioning  of  the  problem  into  sub-problems,  the  specification  of 
appropriate  local  performance  criteria,  and  the  modeling  of  the 
interactions  among  sub-problems  are  all  part  of  an  integrated 
approach  to  developing  a  hierarchical  decomposition.  An 
important  goal  of  this  decomposition  is  to  maintain  a  balance  in 
the  complexity  of  decision-making  effort  across  all  levels  of  the 
hierarchy. 

2.4J  Mission  Planning  vs.  Mission  Management 

The  combining  of  mission  planning  with  in-flight  activity  makes 
it  critical  to  distinguish  between  mission  planning  and  mission 
management  and  to  develop  methods  for  their  proper  interac¬ 
tion.  Whereas  mission  planning  functions  generate  the  specific 
sequences  of  actions  that  deflne  a  mission  plan,  mission  man¬ 
agement  functions  monitor  the  current  situation  for  events  that 
may  require  a  re-planning  response,  determine  the  nature  of  that 
response  by  defining  the  inputs  to  the  mission  planning  function, 
and  control  the  interactions  among  the  levels  of  planning.  The 
mission  management  function  plays  the  role  of  an  executive 
that: 

1)  monitors  progress  relative  to  the  execution  of  the  cur¬ 
rent  mission  plan  and  assesses  the  vehicle's  ability  to 
continue  to  successfully  execute  the  current  plan 

2)  monitors  the  current  situation  for  changes  in  the  slate 
of  the  vehicle  or  mission  environment  that  may  neces¬ 
sitate  a  re-plarming  response 

3)  monitors  any  changes  in  mission  objectives  or  con¬ 
straints  that  may  necessitate  a  re  planning  response 

4)  determines  the  nature  of  the  re-plarming  response  by 
selecting  the  appropriate  planning  algorithms  and 
defming  their  inputs 

5)  controls  the  interactions  among  the  several  levels  of 
the  planning  hierarchy  to  coordinate  the  plarming 
effort. 

Note  that  for  manned  aircraft,  it  is  desirable  that  the  pilot  per¬ 
form  the  in-flight  management  function  and  tor  the  in-flight 
mission  planning  to  be  automated. 

The  mission  management  functions,  at  each  level  of  the  hierar¬ 
chy,  must  decide  whether  to  continue  to  pursue  the  current  plan 
that  is  being  executed  at  that  level  or  to  replan.  Given  that  a 
decision  has  been  made  to  replan,  inputs  must  be  developed  for 
the  planning  algorithms.  In  effect,  those  inputs  define  the  prob¬ 
lem  to  be  solved  by  the  planning  algorithms.  Included  in  the 
inputs  are  the  constraints  or  resource  allocations  that  must  be 
satisfied  by  the  plan  (e.g.,  allocation  of  mission  time,  fuel,  sur¬ 
vivability,  and  weapons  use)  as  well  as  the  objective  function 
that  should  be  optimized  in  developing  the  plan  (e.g.,  minimize 
lethality,  minimize  fuel,  minimize  time,  maximize  effective¬ 
ness).  In  cases  for  which  there  are  multiple  objectives,  the  man¬ 
agement  functions  must  establish  the  relative  importance. 
Finally,  given  that  re-plarming  must  be  performed  in  real-time. 


the  management  functions  must  decide  how  much  time  is  avail¬ 
able  for  planning  and  how  the  on-board  computational  resources 
should  be  allocated  in  generating  a  new  plan. 

Each  of  the  monitoring  functions  described  above  provides 
information  that  is  used  to  decide  whether  or  not  to  initiate  re¬ 
planning.  Meta-planning  literally  translates  to  “planning  about 
plarming"  and  here  refers  to  how  the  process  of  generating  a 
new  plan  is  controlled.  Some  elements  of  meta-plarming  relate 
to  determining  the  level(s)  of  the  hierarchy  at  which  re-plarming 
should  be  performed,  deciding  which  planning  algorithm  to 
employ  at  a  given  level,  and  establishing  the  time  allocated  to 
generating  a  new  plan.  The  last  section  of  the  paper  proposes  a 
method  for  modeling  the  plarming  process  that  provides  insight 
into  how  to  formulate  a  “control  law”  to  insure  stability  of  the 
planning  process. 

Mission  management  musi  be  able  to  distinguish  between  small 
departures  from  the  cunent  mission  plan  that  can  be  corrected 
by  making  small  perturbations  to  that  plan  (e.g.,  changes  in 
coirunanded  airspeed)  at  the  route  plarming  level  and  significant 
departures  that  can  only  be  corrected  at  the  highest  level  of  the 
plarming  hierarchy.  For  example,  meta-plarming  may  initially 
restrict  the  mission  plarming  level  by  requesting  that  it  first 
attempt  to  resolve  any  problems  locally  before  attempting  com¬ 
plete  re-plarming  of  the  mission  level  plan.  Discriminating 
between  small  and  significant  departures  from  plans  generated 
at  all  levels  of  the  hierarchy  is  a  principal  meta-plarming  func¬ 
tion.  For  small  departures,  the  mission  plarming  software  may 
be  directed  to  initiate  re-planning  using  the  current  plan,  poten¬ 
tially  reducing  the  lime  required  to  find  a  good  new  plan.  For 
large  departures,  re-plarming  may  begin  with  a  default  “empty" 
plan,  requiring  the  new  plan  to  be  completely  rebuilt. 

In  a  hierarchical  system,  higher  levels  provide  guidance  to  lower 
levels.  In  the  planning  system,  the  plans  generated  at  higher 
levels  define  both  constraints  and  objectives  that  serve  as 
requirements  for  planning  at  lower  levels.  Mission  management 
is  responsible  for  translating  that  information  into  requirements 
for  lower  levels.  At  each  subordinate  level,  those  requirements 
must  be  properly  interpreted  for  input  to  the  plarming  algorithms 
at  the  subordinate  level.  In  addition,  each  subordinate  level 
must  provide  information  to  iLs  superior  regarding  the  status  of 
the  execution  of  the  plans  that  arc  generated  at  that  subordinate 
level.  The  primary  flow  of  information  within  the  hierarchy  is 
that  requirements  drive  the  planning  process  from  higher  levels 
to  lower  levels,  while  the  changes  in  the  operational  environ¬ 
ment  drives  the  planning  process  from  lower  levels  to  higher 
levels. 

One  of  the  primary  objectives  of  the  design  of  the  architecture 
should  be  to  make  a  clear  distinction  between  reasoning  mecha¬ 
nisms  and  control  mechanisms,  i.c.,  between  mission  planning 
software  and  the  mission  m.-magement  software.  The  architec¬ 
ture  should  be  defined  in  a  manner  that  provides  clean  interfaces 
between  the  mission  planning  software  and  the  mission  man¬ 
agement  software.  The  major  benefit  of  this  approach  is  that  it 
simplifies  the  already  difficult  task  of  designing  the  plarming 
software  by  ensuring  that  mission  management  issues  need  not 
be  addressed  by  the  planning  software  itself  In  addition  the 
mission  plarming  software  can  be  packaged  in  a  modular  fashion 
that  facilitates  the  insertion  of  new  software. 

In  order  to  effectively  replan  a  mission  in-flight  in  real-time,  the 
time  allocated  to  the  mission  planning  software  for  a  specific 
planning  task  must  be  established  by  the  mission  management 
functions,  as  well  as  the  objectives  and  resource  constraints  that 


13 


define  a  planning  problem.  Indeed,  every  plan  rr.usl  begin  at  a 
point  in  both  space  and  time  that  is  reflected  in  its  initial  condi¬ 
tion.  Choosing  that  point  in  the  future  implicitly  bounds  the 
lime  available  to  plan.  Thus,  the  mission  management  fuiK  tions 
are  responsible  for  coordinating  the  choice  of  an  initial  condi 
tion  on  the  planning  process  with  the  planners  at  other  levels 
Furthermore,  the  mission  management  functions  must  decide 
which  plaiming  algorithms  may  be  most  appropriate  given  the 
available  time  to  plan.  Establishing  the  time  to  plan  and  usoci- 
ated  planning  initial  conditions  is  a  non-trivial  decision-making 
problem,  but  one  that  is  crucial  to  the  overall  performance  of  an 
in-flight  mission  planning  capability  system. 

IS  UNMANNED  AIR  VEfflCLES. 

In  the  past  five  Sections,  we  have  described  a  growth  path  for 
mission  plarming  technology  and  its  applications.  Perhaps  the 
ultimate  development  of  this  technology  will  manifest  itself  in 


the  area  o(  L'lmianned  Air  Vehicles.  A  vehicle  can  be  said  to 
have  a  degree  ,>f  julonamy  if  it  has  some  capability  to  sense  its 
own  -late  and  the  state  of  ns  environment  and,  based  on  this  sit¬ 
uational  awareness,  to  plan  and  execute  actions  that  are  designed 
to  achieve  sfwcific  objectives  under  specific  constraints. 
Aui  j  v«-tii<7e.v  have  a  variety  of  possible  aerospace,  land 
and  ased  applications.  Their  potential  use  as  a  force  mul- 
iiplii-i  in  a  variety  of  military  applications  is  of  great  interest. 
They  have  niany  possible  nonniilitary  applications  in  remote  and 
hazardous  kKations.  The  development  of  autonomous  vehicles, 
however,  will  require  technology  breakthroughs  in  vehicle,  sen¬ 
sor.  processor  and  actuator  design.  It  will  also  require  the 
development  of  automated  planning  and  control  systems  that  are 
capable  of  planning  the  vehicle’s  mission  prior  to  its  deploy¬ 
ment.  controlling  the  vehicle's  state  during  the  execution  of  the 
planned  mission  and  re  planning  the  mission  in  order  to 
accommodate  contingencies  that  may  arise  during  mission 
execution. 
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Chapter  3 

Human  Factors  Considerations 


3.1  INTRODUCTION. 

The  developments  in  computer  processing  power  in  recent  years 
have  led  to  the  em{^asis  on  factors  such  as  speed  of  task  execu¬ 
tion.  speed  of  data  access  etc.,  in  existing  and  emerging  mission 
piarming  systems.  The  importance  of  rapid  completion  of  part 
of  or  the  entire  planning  task  has  been  a  driving  factor.  In  the 
more  advanced  systems  the  rapid  processing  capabilities  have 
been  integrated  with  other  features  such  as  intelligent  navigation 
systems,  risk  avoidance  routes,  and  suggested  attack  profiles. 

Although  these  and  other  features  are  important  in  any  effective 
mission  planning  system,  overall  mission  plaruiing  systems 
(MRS)  development  has  rarely  been  driven  by  the  requirements 
of  either  pilots  or  plarmers  but  by  the  developing  technology. 
This  has  led  to  a  design  approach  that  concentrated  on  generic 
mission  models  rather  than  on  a  specific  application  or  the  skill 
requirements  of  the  pilot  or  plarmer 

Despite  efforts  to  improve  the  useability  of  many  MPS,  human 
factor  issues  have  not  yet  played  a  significant  part  in  the  defini¬ 
tion  or  development  of  MPS,  with  little  regard  paid  to  the  re¬ 
quirements  of  the  user. 

A  consequence  of  this  design  approach  is  that  although  technol¬ 
ogy  has  improved  some  aspects  of  tlie  mission  planning  proces.s, 
full  advantage  of  the  technological  advances  available  has  not 
been  made.  There  are  still  many  a.spects  of  current  and  emerg¬ 
ing  MPS  that  are  technology  rather  than  user  requirement 
driven. 

A  more  radical  approach  to  the  design  of  MPS  would  be  that  the 
design  of  the  interface  should  bcaime  a  driving  factor,  as  it  is 
this  area  that  is  becoming  the  main  constraint  improving  mission 
planning  effectiveness.  The  design  should  be  based  upon  the 
man  task  relationship  rather  than  the  task  alone.  The  design  of 
the  interface  should  follow  guidelines  and  principles  that  take 
into  account  the  cognitive  aspects  of  the  task's  interaction  with 
the  system  as  a  whole.  From  this  perspective,  technology  docs 
not  drive  the  design,  it  serves  as  a  means  to  achieve  the  design 
aim. 

A  major  implication  of  this  approach  is  that  the  choice  of  tech 
nology  may  be  derived  from  the  definition  of  the  man  machine 
interface.  However,  the  theory  of  the  man  machine  interface 
based  on  the  analysis  of  the  cognitive  factors  being  the  basis  for 
the  design  of  the  MPS.  has  not  yet  emerged  among  the  numcr 
ous  existing  proposals. 

3.2  TASK  ALLOCATION:  TRUST  AND  CONKIDKNCK. 

The  initial  systems  design  of  any  system,  including  MPS,  must 
concentrate  on  the  functional  requirements,  rather  than  on  the 
selection  of  specific  components  that  are  considered  necessary 
to  achieve  the  desired  functions.  Once  the  functional  descrip¬ 
tion  has  been  determined,  the  allocation  of  fuiKtions  to  the  vari¬ 
ous  system  components  can  take  place.  Allocation  of  function 
can  be  described  as  the  positioning  of  the  boundary  between  the 
operators  and  the  system  hardware,  in  terms  of  the  amount  of 
processing  to  be  performed  by  each  system  component.  The 
problem  of  function  allocation  is  accentuated  by  the  ever  in¬ 


creasing  capabilities  of  the  hardware  components,  which  are 
developing  capabilities  that  were  previously  only  possessed  by 
the  human  component.  Thi.s  inevitably  leads  to  excessive 
demands  for  automation.  This,  in  turn,  has  led  to  the  legitimate 
concern  that  the  strategy  of  automating  all  of  the  aircrew/opera¬ 
tors  tasks  (which  is  perhaps  technically  feasible),  is  unlikely  to 
provide  the  optimum  human-machme  system  (Hollister,  3.1).  Ill 
conceived  introduction  of  automation,  without  a  detailed  analy¬ 
sis  of  the  task  requirements,  may  lead  to  overload/underload  or 
undue  trust  that  the  automation  will  function  correctly. 

Over  recent  years  much  research  eftori  has  been  directed 
towards  defining  the  relationship  between  the  man  and  the 
automated  system.  This  has  resulted  m  the  devclopmenl  of  con¬ 
cepts  such  as  Ojrerational  Rehilionships  (Krobusek,  Boys,  and 
Palko.  3  2).  In  this  .scheme  ten  distinct  categories  of  operational 
relationship  arc  defined.  These  range  from  OR'A .  where  die 
pilot  iierforms  the  activity,  to  OR'G'3,  where  the  system  per¬ 
forms  the  action  autonomousK . 

This  general  concept  of  dynamic  task  allocation,  where  the  level 
of  system  autonomy  is  dejsendenl  on  the  task  and  the  optsrator's 
needs,  has  been  shown  to  hold  jvlential  for  improving  overall 
system  performance  over  siatis  task  allocation.  It  i.>  associated 
with  the  concept  of  the  adaptive  interface  (section  3.4.4.)  and 
offers  jxitential  for  improsu.g  the  future  mission  planning 
process. 

If  the  i.Lsks  may  be  jierformed  by  either  the  operator  or  a  com¬ 
puter.  then  die  operator  and  computer  must  be  viewed  as  a  part¬ 
nership.  each  w-ith  abilities  that  both  overlap  tind  complement. 
There  is  clearly  a  need  for  continuing  research  aimed  at  defining 
task  sharing,  to  ensure  future  MP.S  will  provide  an  effective 
cooperative  relationship  between  o)>erator  ai'd  computer. 

In  designing  fulure  MP.S.  reference  should  be  made  to  design 
standards  such  as  the  N.'\TO  Standardi/alion  Agreement. 
STANAG  3944  Al.  The  Application  of  Human  Engineering  to 
.Advanceil  Aircrew  Systems.  Similar  national  standards/  agree¬ 
ments  also  exist.  These  documents  describe  the  methods  by 
which  human  engineering  procetlures  may  be  integrated  into  the 
design  and  development  process  Two  further  standards  arc 
currently  being  prepared  .Air  Standard  Advisory  Publication 
61/1  IbB  provisionally  titled  Human  Factors  Aspects  of 
Mi.ssion  Planning  Systems"  and  STANAG  7044 Al,  "Functional 
Asjxxls  of  Mission  Planning  System  Interface  Design.  " 

3J  trust  ok  AIRCRKW  in  AUTOMATED  MISSION 
PLANNING  SY.STKMS. 

3J.I  Introduction. 

Mission  planning  both  pre-flight  and  in-flight  arc  tasks  that  have 
been  performed  by  the  aircrew  or  in  some  cases  by  specialist 
mission  planners.  The  development  of  mission  planning  sys¬ 
tems  that  automate  much  of  the  planning  process,  particularly 
using  Al  techniques,  removes  much  of  the  human  element  from 
this  mission-critical  process,  introducing  the  question  of  the 
level  of  trust  and  confidence  the  crew  have  in  the  planned  mis¬ 
sion.  Tnist  and  confidence  are  necessary  if  the  pilot  is  to  rely  on 
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the  MPS  for  assistance  on  decisions  that  are  critical  to  mission 
success  and  survival,  particularly  if  automated  tasks  are  carried 
out  by  implied  consent.  A  lack  of  trust  will  not  allow  the  full 
potential  of  the  man-system  partnership  to  be  realized  and 
reduce  acceptability  of  the  system. 

The  level  of  trust  that  aircrew  may  have  in  a  system  is  dependent 
on  numerous  factors  which  change  over  time.  Muir  [3.3]  de¬ 
scribes  how  trust  changes  but  is  initially  dependent  on  the 
predictability  of  the  system.  Later  on  trust  is  based  on  depend¬ 
ability,  where  in  difficult  situations  the  system  is  seen  to  consis¬ 
tently  provide  useful  information. 

The  level  of  acceptance  and  trust  aircrew  have  in  any  automated 
system  dictates  the  level  of  autonomy  they  are  willing  to  allow 
the  system  and  the  operational  relationship  under  which  they 
wish  to  operate.  An  understanding  of  the  requirements  for  trust 
and  confidence  in  the  design  of  the  systems  may  be  aided  by 
understanding  the  factors  that  affect  the  level  of  trust  aircrew 
have  in  any  automated  system.  This  applies  to  ground  based, 
airborne  and  particularly  embedded  MPS  which  may  be  part  of 
an  integrated  avionics  suite. 

3J,2  Interface. 

The  interface,  and  consequential  interaction,  between  the  pilot 
and  the  system  may  be  designed  to  encourage  the  development 
of  trust  and  confidence.  Such  an  interface  should  have  such 
characteristics  as: 

•  Feedback. 

•  Displaying  confidence  levels.  If  the  system  is  able  to 
assign  a  confidence  level  to  a  decision  made,  the  pilot  is 
then  able  to  make  a  value  judgment  based  on  this  and 
other  information. 

•  Displaying  the  decision  process  when  requested.  The 
derivation  of  a  decision  should  be  displayed  so  as  to  bo 
easily  and  quickly  understood  by  the  pilot,  (including 
sub-decisions,  weightings,  etc.). 

•  Allowing  the  pilot  to  question  a  decision/plan.  The  pilol 
should  be  able  to  question  or  alter  specific  sub  decisions 
to  view  the  effect  on  the  final  decision. 

•  Clarity  of  level  of  autonomy/operational  relationship. 
The  interface  should  unambiguously  display  to  the  pilot 
whether  the  locus  of  control  is  with  the  pilot  or  the 
system. 

•  Allow  pilot  override  of  system  decisions.  A  pilot  re¬ 
quirement  of  any  auUsmated  system  is  that  they  have  the 
capacity  to  override  any  of  the  systems  decisions. 

3JJ  Logic/ReasonlnK. 

The  logic  and  reasoning  employed  or  perceived  as  employed  by 
the  MPS  can  be  a  major  factor  in  the  level  of  trust  in  and  acceo- 
tance  of  a  system  planned  mission. 

•  The  model  with  which  the  system  operates  should  match 
as  closely  as  possible  the  pilot's  own  cognitive  model  of 
the  planning  process.  This  would  allow  the  pilol  to  map 
the  decision  understanding  and  therefore  acceptance  of 
the  decisions  made. 

•  The  system  should  be  tailored  to  match  an  individual 
pilot’s  cognitive  model,  abilities  and  preferences.  If 
individual  differences  are  significant,  for  the  match  to  be 
effective  the  decision  making  process  should  be  tailored 
to  individual  pilots.  This  tailoring  of  the  system  could 


be  extended  to  include  individual  pilot's  abilities  and 
preferences. 

33.4  Who  Plan.s  the  Mission? 

The  level  of  trust  and  confidence  the  pilot  has  may  be  dependent 
on  the  involvement  the  pilol  has  in  the  planning  process,  either 
before  or  during  the  actual  mission. 

•  What,  if  anything,  does  the  pilol  gain  in  terms  of  a 
model'  that  may  increase  confidence,  when  he  plans  the 
mission?  He  may  gain  an  element  of  mission  rehearsal. 

•  If  this  'model'  is  lost  does  the  pilot,  therefore,  have  less 
confidence  in  missions  planned  by  sjK'ciaiist  mission 
planners.  If  so,  is  he  less  able  to  react  effectively  to 
unplanned  events. 

•  Trust  in  the  ability  of  others,  specialists  in  MP.  ui  plan 
the  mission  will  affect  the  level  of  acceptability,  level  of 
autonomy  and  allocation  of  function.  The  optimum 
allocation  of  function  between  the  pilol  and  the  MPS 
must  exist  and  be  unambiguous. 

•  If  the  mission  is  planned  by  ouhers.  the  interface  should 
be  designed  to  allow  the  mission  to  be  rehearsed  in  some 
form  and  to  enable  the  pilot  to  exam.ne  what  if  situa 
tions.  This  feature  requires  careful  consideration  due  to 
the  knowledge  gained  subconsciously  during  the  manual 
planning  process.  If  the  process  is  automated,  such 
knowledge  must  be  transferred  by  the  system, 

•  There  should  he  the  cap.icity  for  the  pilot  to  delegate 
planning  tasks  in  terms  of  both  quantity  and  quality. 
This  must  be  reflected  in  llie  o|>eralional  relationship 
between  the  pilou’crew  .ind  the  MPS.  This  may  be 
dynamic 

333  Development  of  Trust  and  fonTidence. 

How  would  a  pilot  gain  coi.ndciice  during  Uie  introduction  of  an 
MPS'.’  He  may  gam  conndence 

•  If  the  system  is  seen  to  eonsisienily  produce  'better' 
plans  than  the  pilot  using  the  previous  mission  planning 
methodology.  'Better'  may  he  difficult  to  define. 

•  If  the  pilot  develops  failli  in  the  system's  abilities  and 
reliability  over  lime. 

•  If  the  system  produces  plans  quickly  and  in  a  fomiat  that 
the  aircrew  can  understand  as  well  as  modify  in-flight, 
during  the  initial  part  of  rhe  mission,  during  'hurry  up' 
operations. 

33.6  Introduction  of  the  System  to  Develop  Confidence. 

How  would  the  introduction  of  an  MPS  into  service  or  to  the 
pilot  affect  trust  and  confidence? 

•  Inijrxluclion.  initially  of  the  automated  system  as  a  sup¬ 
port  or  decision  aid,  increasing  in  complexity  and  signif¬ 
icance  of  the  support  and  advice  offered.  Gradually,  the 
pilot  would  develop  trust  as  the  system  complexity 
increases. 

•  The  system  is  seen  to  learn  and  develop  using  the  indi¬ 
vidual  pilot's  knowledge.  The  pilot  develops  confidence 
in  the  system’s  abilities,  which  would  be  seen  by  the 
pilol  as  an  extension  of  his  own  ability. 

•  The  system  evolves  with  the  pilot's  capabilities  from 
commencement  of  flying  training,  e.g.,  the  mission  plan 
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may  be  tailored  to  the  individual  pilot's  ability  to  Hy  at 
low  level. 

3J.7  Training . 

Training  would  play  the  major  part  in  developing  trust  in  a 
highly  automated  MPS,  as  training  will  develop  trust  and  famil¬ 
iarity  which  are  critical  factors  if  the  pilot  is  to  accept  the 
system. 

33JS  Others . 

Pilots  are  becoming  more  computer  literate  due  to  exposure  to 
computers  at  school  etc.,  and  thus  may  be  willing  to  accept  and 
trust  the  automated  systems  that  pilots  of  previous  generations 
would  have  rejected.  The  capabilities,  reliability,  etc.  of  the  sys¬ 
tem  is  passed  on  to  the  pilot  by  word  of  mouth  from  other  expe¬ 
rienced  aircrew,  i.e.,  the  system  develops  a  'folklore'. 

3.4  INTERFACE  DESIGN. 

The  user  interface  of  a  MPS  is  the  medium  through  which  a  user 
communicates  with  the  system.  The  form  of  interface  has  a 
major  influence  on  how  a  user  views  and  unders'inds  the  func¬ 
tionality  of  the  system.  Consequently  the  user  interface  can  be 
thought  of  as  those  aspects  of  the  system  with  which  the  user 
comes  into  contact  both  physically  and  cognitively.  The  physi¬ 
cal  aspects  are  dealt  with  in  Chapter  4. 

The  user  interface  has  a  specific  form  of  dialogue  used  to  facili¬ 
tate  user -computer  interaction.  The  dialogue  enables  the  user  to 
map'  the  task  to  the  functionality  of  the  system. 

An  appropriate  and  well  designed  interface  allows  the  user  to 
decompose  the  overall  task  into  sub-tasks  and  map  them  onto 
the  system's  functions.  An  inappropriate  or  poorly  designed 
ir.urface  requires  the  user  to  breakdown  the  task  in  an  illogical 
manner  and  the  ensuing  mapping  is  prone  to  errors. 

The  essential  element  of  interface  design  therefore  involves  the 
user's  comprehension  of  the  tasks  and  the  users  'map'  of  sub¬ 
tasks.  This,  in  turn  requires  an  understanding  of  the  users 
themselves  and  the  influence  on  their  behavior  of  the  context  in 
which  they  work. 

A  factor  crucial  in  the  design  of  the  man-machine  interface  is  to 
ensure  that  the  interface  is  compatible  with  the  planning  pro¬ 
cesses,  which  may  be  dependent  on  factors  such  as  national  mis¬ 
sion  models,  subjective  models  etc.  The  interface  must  also  be 
flexible  in  responding  to  changes  in  requirements  made  upon  it 
as  the  demands  of  the  mission  changes.  To  meet  these  require¬ 
ments  human  factors  must  be  incorporated  in  the  design  process 
at  an  early  stage.  A  standardized  method  for  the  integration  of 
human  engineering  procedures  into  the  design  and  development 
of  advanced  aircrew  systems  is  described  in  STAN  AG  3994  AI. 
Standards  and  guidelines  have  also  been  developed  (e.g.,  MIL 
STD  I472D),  to  assist  in  selection  and  design  of  Man-Machine 
Interaction  (MMI)  for  both  commercial  and  military 
applications.  Their  application  to  MPS  is  primarily  with  the 
MMI  of  ground  based  MPS. 

Extensive  research  effort  is  carried  out  in  the  development  of 
MMI  for  commercial  computer  systems.  Such  developments 
have  an  obvious  direct  application  to  ground  based  MPS.  An 
equal  if  not  greater  effort  is  being  directed  towards  the  devel¬ 
opment  of  the  pilot-cockpit  interface  (e.g.,  big  screen  displays). 
Such  work  is  canied  out  as  part  of  the  integrated  avionics 


development  programs  such  as  Mission  Management  Aid 
(MMA),  Pilots  Associate  (PA)  and  Copilote  Eleclronique.  Such 
work  should  be  considered  when  designing  the  interface  of 
MPS. 

3.4.1  Choice  of  Dialogue. 

It  has  been  said  that  selection  of  an  appropriate  dialogue  is  the 
most  important  decision  made  in  the  design  of  an  interactive 
system.  Dialogue  can  be  described  as  the  specific  method  by 
which  the  system  and  operator  communicate  and  interact.  The 
two  basic  principles  in  selecting  an  appropriate  dialogue  for  any 
application  are  (i)  know  the  user  and  (ii)  know  the  task.  The 
factors  that  must  be  considered  are: 

•  Purpose.  The  purpose  of  the  dialogue  in  MPS  var  es 
with  the  task,  location  and  user  (for  updating  the  meteo¬ 
rological  data  held  on  the  database,  a  data  input  dialogue 
is  required). 

•  User  type  The  potential  users  of  an  MPS  range  from 
clerks,  to  aircrew,  to  specialist  mission  planners.  Users 
may  also  be  intermittent  or  regular  users. 

•  User  role  The  role  of  the  user  may  be  active  or  passive. 

An  active  user  of  an  MPS  (e  g.,  a  specialist  mission 
planner)  will  enter  data.  etc.  The  pilot  of  a  mission, 
planned  by  a  specialist  may  be  a  passive  user.  Users 
may  have  both  functions  at  different  points  in  the  plan- 
nuig  process. 

•  User  intelligence  The  over  or  underestimation  of  the 
user's  capabilities  can  lead  to  the  wrong  choice  of  inter¬ 
face.  This  may  be  a  particular  problem  where  an  MPS 
may  have  users  of  different  capabilities  for  which  differ¬ 
ent  interfaces  arc  appropriate. 

•  Working  conditions.  Working  conditions  are  important 
to  dialogue.  If  the  operator  is  under  stress  due  to  time 
pressure,  the  need  to  interrupt  the  planning  task,  etc.  the 
dialogue  should  reflect  these  stres.sors.  The  environmen¬ 
tal  conditions  and  their  consequences  e.g..  NBC  condi¬ 
tions  may  mean  that  the  operator  will  need  to  wear  NBC 
kit.  reslrictmg  vision  and  finger  dexterity. 

•  Level  of  u.scr  irmning  Differciil  levels  ol  u.ser  training 
that  may  be  expected  of  various  users  of  a  MPS  should 
be  considered  when  designing  the  interface.  The  provi¬ 
sion  and  manner  of  help  facilities  should  also  be 
considered. 

•  type  of  data  The  type  of  data  that  is  being  manipulated 
will  effect  the  dialogue  used  and  the  interface  design, 

(e  g  .  Ground-based  MPS  will  require  geographical 
information  to  be  manipulated). 

•  Importam  e  of  data  accuracy  Tlie  input  of  target  coor¬ 
dinates  and  fuel  load  require  accurate  input  into  the 
mission  plan  The  correct  dialogue  and  interface  design 
should  reduce  the  chances  of  errors  being  made. 

•  Source  of  data  If  possible,  the  dialogue  and  interface 
should  be  related  to  the  form,  organization  and  sequence 
of  the  input  source,  e  g  .  entry  of  mission  data  might  be 
in  the  format  of  the  tasking  order. 

•  Validity  of  data  This  niav  affect  the  dialogue  if  the 
operator  is  unsure  of  the  data  or  its  recency. 

Traditional  forms  of  user  interface  such  as  command  languages, 
form  filling  and  question-and  answer  etc.,  may  still  be  appro 
priatc  for  certain  specific  MPS  functions,  e  g.,  for  the  entry  of 
meteorological  data  a  form  filling  dialogue  may  be  appropriate. 
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Various  forms  of  human-computer  dialogue  have  been,  and 
continue  to  be,  developed.  These  include;  (1)  Direct  Ma¬ 
nipulation  Interfaces  (2)  Ecological  Interfaces  and  (3)  Adaptive 
Interfaces  (Intelligent  Interfaces).  Such  interfaces  or  aspects  of 
each  may  only  be  suitable  for  specific  phases  of  the  mission 
plaiuting  process. 

3.4.2  Direct  Manipulation  Interface  (D\.T). 

User  interaction  with  DMI  may  be  performed  by  the  manipula¬ 
tion  of  on-screen  graphics  e.g.,  windows,  icons  and  menus  by  a 
mouse  or  rollerball  with  WIMP  interface  (Window,  Icon, 
Mouse,  Pull-up/down  menu).  The  interface  is  said  to  be  easily 
used  by  both  novices  and  experts.  All  users  actions  are  repre¬ 
sented  on  the  interface  and  any  change  is  immediately  visible. 
By  representing  the  system.  DMls  can  reduce  the  cognitive  load 
of  the  user,  as  well  as  reducing  the  overall  memory  task  by 
needing  to  remember  fewer,  simpler  commands. 

These  characteristics  convey  a  high  degree  of  transparency  to 
DMI.  allow  the  user  to  deal  only  with  the  task  and  to  not  allocate 
unnecessary  resource  to  the  operation  of  the  system.  Thus  such 
interfaces  are  able  to  reduce  the  cognitive  effort  required  to 
perform  the  task,  e  g.,  plan  a  mission. 

DMI  have  the  following  characteristics: 

•  The  object  of  interest  is  always  on  the  scTcen. 

•  Any  changes  made  by  the  user  are  immediately 
displayed. 

•  Physical  actions  are  used  to  interact  with  objects. 

■  It  is  possible  to  reverse  actions  taken. 

Such  characteristics  provide  benefits  such  as: 

•  Novices  may  quickly  learn  the  basic  functionality  of  the 
sysutm. 

•  Experts  are  able  to  work  rapidly,  use  short-cuts,  and  may 
be  able  to  define  new  functions  and  features 

•  Knowledgeable  but  intermittent  users  may  retain  opera 
tional  concepts. 

•  Users  may  be  able  to  see  if  their  actions  arc  furthering 
their  goals,  and  if  not.  they  may  be  able  to  change  the 
direction  of  tlieir  activity. 

A  DMI  interface  also  encourages  the  development  of  a  direct 
relationship  between  the  operator  and  the  system.  This  direct 
relationship  is  described  as  resulting  from  two  characteristics: 
the  "distance  "  and  the  "engagement". 

"Distance"  refers  to  the  gap  that  exists  between  the  u.scr's  goals 
and  the  way  in  which  operations  must  be  specified  to  the  system 
m  order  to  achieve  the  goals.  "Distance"  refers  to  motor-percep¬ 
tual  pha.ses  (described  as  the  "gulf  of  execution")  and  to  cogni¬ 
tive  phases  (described  as  the  ""gulf  of  evaluation"').  The  interface 
between  the  man  and  the  system  may  therefore  introduce  a 
"gap  "  between  the  goals  of  the  user,  his  knowledge  aixl  the  level 
of  system  description  provided  by  the  interface.  A  DMI  may 
also  be  configured  to  mimic  the  existing  manual  planning 
process. 

"Engagement"  refers  to  the  sense  of  directly  manipulating  the 
objects  of  interest  rather  than  via  another  medium  i.e.,  the 
interface. 


Another  characteristic  of  DMI  is  that  given  the  immediacy  of 
feedback,  the  likelihood  of  making  substantial  errors  is  reduced 
and  if  made,  errors  can  be  cjuickly  corrected. 

However,  there  ate  disadvantages  that  may  need  to  be  consid¬ 
ered.  DMI  cannot  be  configured  as  a  highly  automated  system, 
or  if  automation  is  embedded  within  the  system  few  of  the 
dcsuable  characteristics  will  remain  intact.  In  any  highly  auto¬ 
mated  system  the  "distance"  between  the  user's  intentions  and 
goals,  and  the  system  increases  so  that  the  interface  may  have  no 
direct  influence  on  the  system.  The  sense  of  engagement  may 
also  be  reduced  as  a  consequence  of  the  user's  unfamiliarity  with 
the  system's  logic. 

This  means  that,  if  the  MPS  is  to  be  highly  automated  (e.g,.  to 
reduce  the  time  needed  to  plan  a  mission)  DMI  may  not  be  the 
most  appropriate  form  of  interface  to  employ.  However,  the 
beneficial  attributes  associated  with  DMI  should  be  considered. 

Many  of  the  emerging  MPS,  e.g..  AMPA,  as  well  as  future  MPS 
will  use  DMI/WIMP  type  interface  for  ground  based  MPS  sys¬ 
tems  and  elements  of  the  interfaces  may  be  used  in  on-aircraft 
.systems,  e.g.,  FI8. 

The  developmcni  of  DMI  and  Us  application  to  MPS  will 
conlinue. 

In  order  to  specify  the  characteristics  of  a  DMI,  consider  an 
example  of  a  typical  route  point  insertion  procedure.  This  may 
be  divided  into  two  ajiplicalions; 

•  a  DMI  design  for  a  ground-based  MPS. 

•  an  on  board  version  for  m  llighl  operations. 

DMI  in  a  ground  based  MPS  is  basically  a  method  of  presenting 
to  the  ojrerator  a  number  of  automated  tools  to  be  used  in 
performing  certain  lyiKS  of  task.  The  core  of  the  DMI  is 
embedded  in  Uie  software  design,  which  is  developed  mainly  on 
the  basis  of  icons  used  by  the  o|X.'ralor  to  access  different  func¬ 
tions  on  a  disj'lay. 

It  may  be  assumed  lhai  the  MPS  provides  a  high  resolution 
graphic  display  (CRT  or  LCD'  with  a  number  of  symbols  over¬ 
laid  on  different  images. 

These  images  may  be  video  or  still  frames  derived  from  some 
fonv.  of  mass  data  storage  (e  g  .  Laser  disks)  or  graphics  gener¬ 
ated  by  a  graphics  com|niter . 

The  jrrimary  ch.aractcristic  of  DMI  design  is  that  the  functions 
are  accessible  to  the  operator  at  any  given  moment  by  selection 
of  easy  to  understand  icons.  The  operator  can  select  a  particular 
function  oy  use  of  a  manipulation  interface  (mouse,  touch - 
screen  etc  ),  m  conjunction  w  nh  a  keyboard.  Results  of  this 
action  are  immediately  presented  on  the  same  display,  automati 
cally  rearranging  the  icon  layout  as  required. 

1)  Via  the  display  the  system  asks  the  operator  ui  enter 
aircraft  type  and  wcaptrn  load.  An  icon  would  be 
available  to  present  the  permitted  weapon  load  and 
configuration. 

2)  A  large  map  of  the  operations  area  is  then  presented. 
The  operator  is  able,  by  use  v>f  the  mouse,  to  enlarge 
(Avom)  the  area  of  mterest. 

3)  As  soon  as  the  enlarged  area  is  presented,  all  airfields 
are  highlighted  and  the  operator  is  given  the  option  to 
select  a  home  airfield,  landing  airfield  (if  different 
from  iKime)  and  a  nuinb-r  of  alternates. 
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4)  The  opeiniur  is  now  given  the  choice  to  select  the  first 
waypoint  in  the  route. '  A  zoom  icon  may  be  available 
to  assist  the  operator  in  selecting  the  correct  waypoint. 

If  a  digital  land  mass  storage  system  is  available,  the 
option  of  presenting  the  information  on  a  particular 
point  (e.g.,  height,  type,  visibility  hints,  etc.)  may  be 
iiKluded  by  selection  of  a  dedicated  icon. 

5)  The  operator  is  now  asked  to  input  route  leg  altitude, 
speed  and,  if  required,  time  on  waypoints.  The  system 
automatically  computes  and  presents  leg  duration  and 
an  estimated  fuel  consumption.  This  value  may  be 
corrected  at  the  end  of  the  plarming  process,  when  the 
recommended  fuel  uplift  is  presented. 

6)  As  with  (4),  the  operator  now  selects  further  way- 
points.  As  new  waypoints  are  inserted,  the  system 
automatically  computes  and  displays  the  turn  path 
from  the  previous  waypoint  to  intercept  the  next  leg. 

If  the  operator  requires  a  specific  course  to  a  waypoint, 
this  may  be  selected  via  a  dedicated  icon.  At  any  step, 
if  the  operator  forces  a  parameter  that  is  in  contrast 
with  other  requirements  (e  g.,  a  time  over  a  waypoint 
incompatible  with  the  leg  speed  required),  the  system 
highlights  the  anomaly,  and  may  suggest  suitable 
solutions. 

7)  (>n  completion  of  the  route  insertion,  the  system  com¬ 
putes  fuel  quantity  required  at  take-off  (taking  into 
consideration  the  attack  pha.se.  not  discussed  in  this 
example). 

8)  The  operator  is  now  able  to  alter  the  route  as  required 
and  adjust  any  parameter  in  order  to  optimize  the 
mission. 

In  an  on  board  MP.S,  the  DMI  will  be  designed  to  the  s.-une 
principles  as  the  ground  based  version,  but  with  dilferenccs  due 
mainly  to  the  limitations  iiiqKiscd  by  pilot  workload  during 
mission  execution  and  state-of-the-art  technology. 

In  fact,  airborne  display  technology  could  limit  resolution  of  the 
image,  thus  having  some  effect  on  icon  design.  .Similarly,  today 
display  dimen.sions  are  usually  in  the  5''x  5"  to  6"x6"  range, 
again  limiting  the  amount  of  information  that  can  be  presented. 
Also  to  be  considered  is  the  fact  that  on-board  digital  map 
generators  arc  yet  under  development  and  film  based  map 
readers  are  not  adequate  for  the  job 

In  addition,  pilot  inputs  to  the  system  can  be  made  normally 
using  some  form  of  joystick  or  Pilot  Hand  Controller  (PHC) 
connected  to  a  cursor  on  the  displays  and  supjxitted  by  mul'i 
function  keyboards.  This,  together  with  the  cnvirotuiicntal  con 
straints  of  an  aircraft  cockpit,  means  that  the  manipulation  of 
data  on  the  display  is  likely  to  be  more  degraded  than  in  a 
ground  based  applicat'on.  Possible  future  devices  such  as  eye 
pointing  systems  may  overcome  this  limitation. 

However,  the  in  flight  use  of  a  MI’S  will  be  limited  in  many 
cases  to  re  planning  functions  following  the  need  to  diverge 
from  the  planned  mission  .Since  the  need  for  re  planning  comes 
in  the  vast  majority  of  cases  from  a  change  of  the  tactical 
scenario  or  following  some  form  of  aircraft  failure,  the  lime 


1  These  process  stages  may  be  performed  by  the  system. 
However,  for  the  sake  of  this  example,  a  manual  step  by 
step  process  has  been  chosen.  As  soon  as  the  operator 
selects  the  waypoint,  the  leg  from  the  home  airfield  to  it 
is  drawn  on  the  screen,  and  length  of  the  leg  and 
a.ssociated  data  automatically  computed  and  displayed. 


burden  on  the  pilot  should  require  a  careful  design  of  the  DMI  in 
order  to  allow  him  to  make  correct  choices. 

The  following  example  of  a  typical  in-flight  route  replanning 
procedure  can  be  made: 

1)  Tlie  pilot  becomes  aware  of  a  change  in  the  operational 
scenario  that  requires  a  cJiange  of  the  planned  mission, 
e.g.,  the  need  to  change  the  primary  target  (or,  alterna¬ 
tively.  the  system  becomes  aware  of  the  change  and 
suggests  the  pilot  modify  die  plan), 

2)  On  a  display  available  in  the  cockpit  the  map  of  the 
operation  area  can  be  accessed  by  the  pilot.  The  pilot 
is  able,  with  the  PHC.  to  enlarge  (zoom)  the  area  of 
interest. 

3)  Pressing  a  soft-key  available  on  the  display  the  pilot 
requires  a  re-planning  facility.  The  PHC  can  then  be 
used  to  select  the  new  target  on  the  map.  A  zoom  icon 
shall  be  available  to  help  the  pilot  in  selecting  the 
correct  point.  If  a  Digital  Land  Mass  Storage  System 
(DLMS)  is  ava3able.  the  option  of  presenting  infor¬ 
mation  on  a  particular  point  (e.g..  height,  type,  visibil¬ 
ity  hints,  etc.)  should  be  included  by  picking  up  a  dedi¬ 
cated  icon. 

4)  As  soon  as  the  pilot  selects  the  new  target,  the  MPS 
tries  to  adjust  the  previously  planned  route  in  order  to 
cope  with  tile  new  requirement.  If  this  attempt  is  suc¬ 
cessful.  the  pilot  is  shown  the  modified  plan;  if  it  is  not 
possible  to  retain  the  planned  route  within  a  certain 
limit,  the  system  informs  the  pilot  of  the  need  to  select 
a  new  set  of  route  points  (possibly  suggesting  a  suit¬ 
able  solution). 

,3)  The  pilot,  moving  with  ihe  PHC  on  the  map  display, 
injiuts  the  new  waypoin's,  then  he  is  asked  to  input  leg 
altitude,  speed  and.  if  required,  time  on  waypoint. 
Tliis  can  be  done  cither  by  using  a  multi-function  key¬ 
board  or  w  ith  the  PHC  inside  ad-hoc  windows  on  the 
display.  The  system  automatically  computes  and 
presents  leg  duration  and  an  estimated  fuel  consump¬ 
tion.  At  any  new  way[»int  insertion  the  .system  auto¬ 
matically  computes  and  displays  the  turn  path  on  the 
previous  waypiiini  lo  intercept  the  leg  If  the  pilot 
intends  lo  force  a  particular  course  to  a  waypoml  this 
can  be  done  by  selecting  a  dedicated  icon.  .At  any  step, 
if  the  pilot  forces  a  par.imeler  that  is  in  contrast  with 
other  requirements  (e  g..  a  time  over  a  waypoint 
incom|iaiible  with  the  leg  sjx'ed  required)  the  system 
highlights  the  conflict  and  suggests  lo  the  pilot 
dilfereiit  values 

6)  When  the  process  of  route  optimization  is  completed, 
the  pilot  selects  an  aiipropnale  soft  key  and  the  new 
route  IS  stored  in  the  system  memory  imd  used  for  the 
res'  ol  the  mission 

.3.4.3  Kcological  Interface  Design  (KID). 

A  limitation  of  DMI  is  that  of  cognitive  control.  The  planner 
devotes  attention  to  the  piuameters  and  variables  concerned  with 
Ihe  mission  plan.  Attention  is  also  required  with  ihe  task 
domain,  control  of  the  interface,  and  possibly  of  the  overall 
system.  This  may  result  in  the  reduction  of  resources  available 
for  the  planning  task.  Dc[icnding  on  the  time  available,  user 
expertise  and  the  expected  risk,  altenlional  resources  arc  pre 
dominalely  concerned  with  the  preparation  of  the  mission  plan. 
This  makes  the  unattended  activities  vulnerable  lo  error.  DMI 
may  not  resolve  -.uch  errors,  whereas  El  is  concerned  specifi¬ 
cally  with  such  errors 
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The  Ecological  Interface  Design  (EID)  deals  with  the  theory  of 
interface  design,  based  on  Rasmussen's  [3.4]  ladder  model  of 
control  of  behavior  in  complex  tasks.  The  theory  has  much  in 
common  with  that  behind  OMI,  particularly  as  it  recommends 
making  the  properties  of  the  task  domain  apparent.  For 
example,  easier  operation  may  be  achieved  when  icons  that 
represent  the  operation  are  used. 

Important  guidelines  for  the  design  of  interfaces  may  be  derived 
from  the  theory.  These  guidelines  underline  the  need  for  the 
user  to  be  able  to  make  mental  simulations,  e.g.,  "what ....  if 
styles  of  reasoning  of  the  tasks  Such  simulations  are  aimed  at 
understanding  the  acceptable  liniits  of  performance,  whi 
factors  involve  the  greatest  risk  etc.  Immediate  and  continuous 
feedback  as  to  the  result  of  actions  taken  and  their  consequences 
are  thus  essential  for  the  user.  The  interface  should  also  take 
into  account,  where  possible,  all  the  jncertainties  of  the  mission 
to  be  undertaken. 

The  principal  aim  of  the  EID  is  that  the  interface  docs  not  force 
the  cognitive  control  required  by  the  user  to  a  different  level 
than  that  desired  by  the  user,  is  necessary  to  take  into  account 
the  fact  that  multiple  representations  are  used  by  the  planners  for 
problem  solving,  each  requiring  information  support.  The  inter¬ 
face  should  support  the  user's  information  requirements 
concerning  the  "current  situation",  the  "target  state"  and  the 
"action  required". 

Practically,  an  EID  should  consist  of  the  same  hardware  as  the 
DMI  (Section  3.4.2.).  The  major  differences  arc  that  the  icons 
of  the  EID  should  be  able  to  be  enlarged  to  become  windows 
incorporating  an  area  (See  note  2)  in  which  particular 
parameters  are  changeable  by  the  operator  off-line,  i.c.. 
changing  them  shall  have  no  effects  on  the  process  unless  an 
"accept"  command  is  given.  The  changing  of  these  parameters 
should  be  reflected  by  modifying  a  '"preview"  area  of  the 
window  itself,  to  improve  the  description  of  the  results  of  the 
modification  of  each  parameters. 

To  better  understand  this  rationale  and  compare  it  to  the  DMI 
design,  we  describe  the  route  insertion  process  already  detailed 
in  Section  3,4.2  as  it  could  be  dealt  with  using  an  EID. 

1 )  and  2)  are  basically  the  same  as  previously  seen. 

3)  As  soon  as  the  enlarged  area  is  presented,  all  airfields 
are  highlighted  and  the  operator  is  given  the  option  to 
select  home  airfield  and  the  landing  airfield  (if  differ¬ 
ent  from  home).  He  can  then  select  alternate  airfields 
selecting  an  appropriate  window  on  which  the  airfield 
within  a  fixed  range  from  the  landing  airfields  are 
shown.  Within  this  window  an  area  shall  allow  selec¬ 
tion  of  a  different  landing  field  and  the  assrKiated  fuel 
needed  -  turn  over  capability,  and  time  implications  arc 
then  presented.  When  the  operator  decides  to  select 
the  appropriate  landing  airfield  the  selection  is  trans¬ 
ferred  to  the  complete  format  on  the  display. 

4)  The  operauir  is  now  given  the  choice  of  selecting  the 
first  waypoint  in  the  route.  A  zoom  icon  shall  he 
available  to  help  the  operator  in  selecting  the  correct 
waypoint.  If  a  DLMS  is  available,  the  option  of  pre¬ 
senting  information  on  a  particular  point  (e.g.,  height, 
type,  visibility  hints,  etc.)  should  be  included  by  pick¬ 
ing  up  a  dedicated  icon.  As  soon  as  the  operator 
selects  the  waypoint,  the  leg  from  the  home  airfield  to 
it  is  drawn  on  the  screen,  and  length  of  the  leg  auto¬ 
matically  computed. 

5)  Now  the  operator  is  a.sked  to  input  leg  altitude,  speed 
and,  if  required,  time  on  waypoint.  An  appropriate 


window  shall  be  available  in  which  the  pilot  can  input 
parameter  value,  and  in  which  automatically  computed 
leg  duration  and  estimated  leg  and  total  fuel  consump¬ 
tion  are  displayed  together  with  suggested  parameter 
values  (e.g.,  best  fuel  consumption  speed  and  height 
for  a  cruising  leg).  When  the  operator  judges  that 
these  values  are  correct  he  accepts  them  and  the  leg  is 
displayed  on  the  full  display.^ 

6)  Operating  in  the  same  way  as  step  4,  the  operator  now 
selects  the  next  waypoint.  On  an  appropriate  window 
the  operator  is  given  the  possibility  of  previewing  the 
turn  from  the  previous  waypoint  to  intercept  the  next 
leg  and  to  select  a  particular  course  to  a  waypoint. 
Any  selection  that  is  in  contrast  with  other  require¬ 
ments  (e.g.,  a  time  over  a  waypoint  incompatible  with 
the  leg  speed  required)  will  not  be  allowed  to  be 
entered  and  the  incompatible  features  highlighted  to 
the  operator.  Again,  when  the  choice  has  been  made 
the  MPS  reflects  the  change  in  the  route  for  immediate 
display  to  the  operator. 

7)  The  operator  is  now  able  to  change  the  route  as 
required  adjusting  any  parameter  he  wishes  in  order  to 
further  optimize  the  mission.  To  do  this,  an 
appropriate  window  is  displayed  in  which  the  change 
of  any  significant  mission  parameter  is  reflected  on  the 
whole  mission,  helping  the  operator  in  selecting  the 
correct  value. 

In  the  case  of  an  on  board  MPS.  llie  EID  will  adopt  the  same 
principles  as  the  ground  based  version,  with  the  conditions  as 
seen  in  Section  .3  4.2  for  a  D.MI. 

3.4.4  Adaptive  Interfaces. 

One  of  the  most  psiwerful  methods  of  supporting  the  informa¬ 
tion  processing  at  the  infereneing  level  is  by  modeling  the 
reasoning  and  decision  making  process.  This  is  the  objective  of 
the  adaptive  (or  intelligent)  interface.  The  adaptive  interface 
operates  on  a  cooperative  basis,  where  functions  are  shared 
between  man  and  machine.  Tliese  interfaces  reflect  the  flow  of 
information  and  locus  of  conuol  between  man  and  the  system. 
Adaptive  also  refers  to  the  supixsrt  the  system  offers,  adapting  to 
the  needs  and  capabilities  of  the  user,  by  taking  into  account  his 
limitations.  Adaptive  Interfaces  may  therefore  be  particularly 
suitable  for  in -flight  mission  pl.mning.  where  data  fusion  may  be 
taking  place  . 

Adaptive  interfaces  are  aimed  at  optimizing  operator  perfor¬ 
mance  only  at  the  times  when  supixirl  is  needed.  This  approach 
is  an  altemaiive  to  the  concept  of  automating  the  entire  task  if 
ihc  suitable  technology  is  avail.iblc 

Tins  approach  envisages  automation  as  a  "back  up  ".  A  default 
level  would  K-  where  all  tasks  .ire  nuuiual;  automation  will  only 
ocvur  when  s(>ccifically  requested  by  the  operator  or  when  the 
performance  level  is  considered  unacceptable.  This  approach  to 
the  design  of  automated  support  should  result  in  models  of 
interaction  which  lake  imo  aceounl  both  the  variation  in  task 
demands  ami  the  mental  resources  available. 

A  major  interface  design  topic  addressed  by  the  adaptive  inter¬ 
face  is  the  issue  of  the  transfer  of  control  between  (he  operator 


^  Thi.s  window  can  be  an  expansion  of  the  icon  itself 
when  "clicked"  or  the  access  to  a  dedicated  format. 
Particular  care  shall  be  used  in  order  that  the  operator 
be  always  aware  of  the  fact  of  being  inside  a  "what... .if 
routine). 
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and  the  system,  and  the  allocation  of  tasks.  The  interface  plays 
an  important  role  in  organizing  the  distribution  of  activities. 
With  such  systems  the  interface  operates  as  an  executive  assis¬ 
tant,  whose  key  function  is  that  of  recognizing  human  limita¬ 
tions  and  organizing  task  agendas.  Sub-systems  monitor  opera¬ 
tor  performed  tasks  and  derive  an  assessment  of  the  pyschologi- 
cal  and  physical  performance,  evaluate  the  complexity  of  the 
subsequent  task,  and  produce  a  strategy  on  how  to  assist  the 
operator.  It  can  operate  as  an  on-line  expert  system  which 
through  cooperation  with  other  avionics  systems  may: 

•  receive  information  and  requests  from  sensors,  subsys- 
tems  and  operator. 

•  assign  priorities. 

•  evaluate  time  criticality. 

•  schedule  requests,  messages  and  information  into  task 
sequences. 

In  order  to  reduce  arbitrary  decisions,  the  interface  manager  is 
envisioned  as  a  hierarchical  representation  of  goals,  plans  and 
actions.  Therefore  task  allocation  is  based  not  only  on  a  consid¬ 
eration  of  the  current  demands,  but  on  the  evaluation  of  impend¬ 
ing  problems. 

As  with  DMI  and  EID  interfaces,  a  typical  application  of  an  AI 
can  be  described.  However  it  is  essential  to  stress  that  white 
DMIs  and  EID  require  state-of-the-art  technology,  the  AI 
requires  forms,  software  and/or  hardware  that  are  not  yet 
available. 

AI  requires  some  form  of  monitoring  the  operator's  psychologi¬ 
cal  and  physiological  status  during  the  task.  This  may  be  done 
quite  easily  in  some  applications,  such  as  learning  aid  devices, 
in  which  the  pupil  answers  automatically  presented  questions 
which  are  used  by  the  system  to  infer  the  pupil's  knowledge  gain 
and  thus  define  the  next  set  of  questions.  In  the  case  of  an  MPS 
operator,  the  problem  of  the  method  by  which  the  system 
understands  the  operator's  cognitive  status  has  yet  to  be  devel¬ 
oped.  The  complexity  of  defining  such  a  system  suggests  that 
the  use  of  an  Ai  in  MPS  would  be  limited  to  high  stress  situa¬ 
tions,  e.g.,  in-flight  operations. 

It  is  assumed  that  the  AI  interfaces  with  all  the  onboard  systems, 
and  a  user  behavior  model  that  allows  the  AI  to  monitor  and 
assess  the  pilot's  psychological  and  physical  status  during  all 
phases  of  the  mission  has  been  developed.  This  will  allow  the 
system  to  decide  if  a  stress  situation  exists  and  whether  auto¬ 
matic  intervention  by  the  system  is  required. 

By  monitoring  system  status  and  the  tactical  situation,  the  pilot 
may  be  tasked  by  the  sub  system  to  perform  only  very  high  pri¬ 
ority  tasks. 

In  a  routine  mission,  the  AI  will  continuously  monitor  a  number 
of  parameters,  and  using  an  embedded  cognitive  model  of  the 
pilots  behavior,  develop  a  strategy  for  future  system 
intervention. 

If  a  situation  develops  in  which  the  AI  decides  that  the  pilot 
requires  assistance,  the  specific  information,  the  form  in  which 
it  is  to  be  presented  and  its  criticality  will  be  generated  by  the 
AI.  alerting  the  pilot  and  suggesting  a  particular  course  of 
action.  However,  the  decision  to  comply  shall  still  be  the  pilot's 
own  judgment,  although  more  detailed  information  would  be 
accessible  to  the  pilot  on  demand. 


Using  the  planning  ta.sk  described  in  Sections  3.4.2  and  3.4.3 
adapted  to  an  in-flight  route  replanning  sequence  using  an 
Adaptive  Interface,  the  following  steps  would  occur: 

1)  Inbound  to  the  target  area,  on  a  cockpit  display,  the 
planned  route  is  shown  by  overlaying  a  map.  The  pilot 
monitors  the  route  and  other  major  navigation  parame¬ 
ters.  A  monitoring  system  continuously  assesses  spe¬ 
cific  mission  parameters  comparing  them  with 
exjiccted  values. 

2)  If  the  system  detects  a  failure  in  an  on-board  system 
which,  e.g..  reduces  the  available  fuel,  the  system  will 
replan  the  route,  height  and  waypoints  and  time  over 
target.  The  pilot  is  alerted  by  a  warning  and  a  display 
provides  details  of  the  failure  and  all  necessary 
information  needed  to  support  the  pilot  in  making 
subsequent  tactical  decisions. 

3)  The  new  plan  is  accepted  or  rejected  and  the  mission 
continues. 

4)  On  entering  the  target  area  and  approaching  the  Initial 
point,  the  system  may  be  alerted  by  an  AWACS  in 
proximity  to  the  target  that  a  SAM  site  has  become 
active.  The  system  decides  that  a  different  approach  to 
the  target  is  required  in  order  to  avoid  the  SAM  danger 
area.  Using  the  target  information,  the  route  replan¬ 
ning  rules  in  the  system  and  the  terrain  data  available 
from  the  on-board  Map  System,  the  MPS  may  re¬ 
assess  the  run-in  direction  and  height,  to  make  best  use 
of  the  terrain  masking  offered  by  the  area  around  the 
target.  Due  to  the  need  to  act  immediately,  the  MPS 
replans  the  route  and  advises  the  pilot  of  the  necessity 
and  urgency.  However,  all  information  on  the  modi¬ 
fied  tactical  situation  and  rationale  behind  the  system 
suggested  actions  is  made  available,  together  with 
information  on  the  confidence  level  that  the  system  has 
in  the  changes  made. 

The  AI  concept  is  only  a  stage  below  that  of  full  automation  of 
mission  planning  tasks,  and  its  intrinsic  advantages  are  that  the 
operator  is  confident  that  an  "electronic  associate"  is  monitoring 
his  behavior,  ready  to  intervene  as  soon  as  required.  During 
normal  operation  the  same  system  may  act  as  an  intelligent 
information  retrieval  system  and,  if  interrogated,  suggest  alter¬ 
native  solutions  to  the  current  situation.  In  addition,  since  a 
dynamic  allocation  of  tasks  can  be  made  available,  the  pilot  can 
select  at  any  moment  which  tasks  are  left  to  the  machine  and 
which  are  fully  retained  by  him. 

Fully  fledged  adaptive  interfaces  as  yet  may  not  exist  but  their 
importance  in  all  aspects  of  cockpit  automation  ensure  their 
inclusion  in  many  research  programs  A  major  difficulty 
encountered  with  such  an  approach  is  the  reluctance  of  aircrew 
to  acccjit  such  automated  supjxirt. 

Reasons  ftir  this  reluctance  are  many,  but  on  the  understanding 
that  this  may  be  an  area  where  the  limitations  of  the  system 
become  most  apparent,  it  may  be  concluded  that  this  is  an  area 
where  more  research  is  required.  Effort  should  be  devoted  to 
the  understanding  the  coordination  and  communication  pro¬ 
cesses  between  man  and  systems  in  multi-tasking  enviroiuncnls. 

The  acceptance  of  decision  support  by  operators  is  based  on  the 
capability  to  establitth  trust  and  confidence.  A  major  problem  is 
the  paradox  of  allocating  control  and  authority  to  the  system, 
while  final  responsibility  remains  with  the  human  operator. 
Thus  research  efforts  should  be  devoted  to  the  understanding  of 
the  modalities  to  increase  trust  and  confidence.  This  may  be 
carried  out  by: 
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•  the  improvement  of  operator  capability  to  perceive  the 
reliabdity  and  limitations  of  a  decision  support  system. 

•  the  modifications  of  the  criteria  by  which  trust  and 
confidence  are  established. 

•  the  improvement  in  capability  of  the  operator-system 
to  allocaU;  functions  to  the  system  e.g.,  make  transpar¬ 
ent  human  limitations. 

•  identify  areas  where  trust  is  failing,  and  the  need  to 
actively  support  and  reinforce  where  necessary. 

Mission  rehearsal  and  "computer  aided  instruction"  represent 
two  examples  of  how  to  increase  trust  and  confidence  on  plan¬ 
ning  tasks. 

3S  SOFTWARE  TOOLS  AND  PROTOTYPING. 

There  is  increasing  development  and  use  of  interface  design 
tools  in  the  design  and  development  of  commercial  civil  com¬ 
puter  systems.  Such  tools  should  enable  the  interface  designers 
of  MPS,  (predominately  the  ground  based  systems),  to  produce 
more  suitable  and  effective  interfaces  in  shorter  time  scales  and 
as  part  of  an  iterative  design  process. 

3.5.1  Graphics  Tools. 

The  use  of  graphics  tools  allows  the  user  to  create  and  manipu¬ 
late  on-scr^n  graphics,  e.g.,  windows,  icons  etc.,  as  well  as 
graphic  objects  such  as  dials  and  buttons.  In  addition  to  simply 
designing  the  layout  -  the  representational  aspects  -  the  interface 
designer  must  link  the  screens,  images,  and  text  to  the  functions 
of  the  system,  and  sequence  the  images  in  order  to  describe 
operational  aspects  of  an  interface. 

3.5  J  Modeling  and  Diagramming  Tools. 

Modeling  tools  can  either  be  graphically  based  or  text  based,  but 
in  addition  to  merely  allowing  graphics  or  text  manipulation, 
they  may  also  check  and  maintain  the  syntax  and  semantics  of 
the  model.  This  gives  the  benefit  that  code  may  be  produced 
from  a  syntactically  conect  model. 

3.5  J  User  Interface  Management  Systems  (UIMS). 

A  UIMS  frees  the  interface  designer  from  the  low  level  details 
of  the  interface  while  providing  a  set  of  tools  with  which  to 
manipulate  the  elements  of  the  interface.  A  UIMS  may  consist 
of  three  essential  pans; 

•  graphics  and  text  manipulation  tools 

•  linkage  function  that  defines  the  operational  aspects  and 
links  the  interface  design  to  the  functionality  of  the 
system. 

•  management  function  that  controls  the  interaction  during 
the  running  of  the  system. 

UIMS  are  still  under  development  and  details  of  their  method  of 
operation  have  yet  to  be  defined.  However,  their  is  little  doubt 
that  the  individual  elements  of  UIMS  will  come  together  to  form 
a  specific  tool,  particularly  as  development  methodologies  such 
ax  SSADM  and  initiatives  such  as  MANPRINT  recognize  and 
highlight  the  importance  of  the  interface  design. 

3.54  Prototyping. 

An  effective  and  appropriate  MPS  interface  is  the  product  of  the 
interface  being  both  a  major  component  of  the  MPS  design  and 


as  a  result  of  an  iterative  design  process.  Iterative  design  has 
been  facilitated  by  the  ability  to  create  and  use  software  proto¬ 
types  which  simulate  the  functionality  and  operation  of  a  sys¬ 
tem.  A  prototype  should  be  cheap  and  take  only  a  short  time  to 
develop,  hence  the  use  of  the  term  rapid  protoyping.  A  proto¬ 
type  interface  is  an  interface  that : 

•  actually  works 

•  may  be  either  discarded  or  evolve  into  the  final  system 

•  be  built  quickly  and  cheaply 

•  forms  part  of  an  iterative  design  process  and  which 
therefore  can  be  modified  and  re-evaluated. 

Commercial  prototyping  software  such  as  VAPS  and  TIGERS 
are  available  which  run  on  graphics  workstations,  while  a  more 
flexible  alternative  is  to  directly  produce  the  prototype  using  C 
code  and  graphics  libraries.  Such  systems  allow  complex  and 
dynamic  prototype  displays  to  be  generated.  Simpler  prototyp¬ 
ing  tools  that  may  run  on  PCs,  allow  form-filling  or  DMI  type 
interfaces  to  be  developed. 

Prototyping  is  an  essential  and  integral  part  of  the  iterative 
design  process  and  allows  constant  evaluation  by  the  operators 
as  part  of  programmed  operator  trials,  which  allows  users  to 
develop  an  understanding  of.  and  confidence  in.  the  new  system. 
A  dynamic  prototype  interface  with  which  actual  or  potential 
operators  can  interact  will  encourage  task  expertise  to  surface, 
which  can  oe  fed  back  into  the  interface  design.  Prototypes  can 
be  used  by  the  interface  designer  to  elicit  information  from  the 
operators  on  the  most  appropriate  system  snucture  and  func¬ 
tionality.  operation,  required  representations  and  operator  sup¬ 
port  needs. 

3.6  MIS.SION  REHEARSAL. 

The  concept  of  mi.ssion  rehearsal  is  becoming  an  increasingly 
important  future  capability  in  mission  planning  systems.  The 
requirement  to  support  this  function  and  the  unpact  on  the  inter¬ 
face  requires  greater  investigation. 

Rehearsal  may  take  place  as  piut  of  the  planning  process  or  as  a 
separate  function  after  the  mission  has  been  planned. 
Technology  plays  an  important  role  in  producing  the  require¬ 
ment  for  mission  rehearsal.  Automation  is  reducing  the  active 
"hands  on"  participation  of  the  planner  and  the  cognitive  model 
the  planner  would  build  up  unconsciously  during  planning  is 
lost. 

Increasingly  technology  may  assist  the  rehearsal  of  the  mission 
by  providing  the  systems  capabilities  to  support  rehearsal.  This 
may  compensate  for  the  decrease  in  familiarization  with  the 
mission.  To  ensure  the  design  of  the  interface  is  able  to  support 
mission  rehearsal,  the  requirements  for  mission  rehearsal  and 
the  implications  for  the  planning  process  as  a  whole  must  be 
undcrstixHl. 

Rehearsal  capabilities  arc  already  present,  to  some  extent,  in 
systems  already  in  service  or  being  developed.  However  they 
are  part  of  the  planning  process  and  the  rehearsal  aspects  are 
implicit.  Development  is  directed  towards  more  explicit  support 
to  the  rehearsal  process. 

The  high  level  of  interaction  that  the  existing  MPS  require 
means  that  the  chosen  solution  is  inferred  from  a  set  of  heuristic 
rules  which  vary  according  to  ihc  mission  plan.  Planners  adapt 


them  to  the  known  mission  plan  conditions,  gain  familiarity  and, 
as  a  consequence,  control  of  the  mission. 

Emerging  mission  planning  systems  allow  a  level  of  rehearsal  to 
take  place.  For  example,  they  may  provide  three-dimensional 
perspectives,  others  provide  "out-of-the-cockpit"  views  with  the 
ability  to  zoom  in  and  out  of  the  view.  Another  rehearsal  func¬ 
tion  is  the  capability  to  "fly  through”  the  route  in  faster  than  real 
time  or  slowly  through  difficult  stages  and  quickly  through  less 
difficult  stages.  The  role  of  the  mission  planner  will 
undoubtedly  change  with  the  introduction  of  emerging  planning 
systems,  due  to  the  introduction  of  capabilities  such  as  mission 
rehearsal. 

MRS  should  be  capable  of  supporting  mission  rehearsal  Ixith 
during  the  planning  process  and  after  the  plan  has  been  final¬ 
ized.  Time  availability  and  the  type  ol  man-system  collabora¬ 
tion  are  the  two  main  factors  that  affect  rehearsal  potential. 

When  time  is  available,  planners  pay  conscious  attention  to  crit¬ 
ical  a.specLs  of  the  mission,  and  to  evaluate  possible  aliematives. 
If  the  planner  is  able  to  choose  from  a  number  of  alternatives, 
tlien  he  makes  an  implicit  correlation  between  local  detailed 
solutions  and  the  global  overall  plan.  This  hamioni/atiun  pro¬ 
cess  is  dependent  on  the  level  of  interaction  that  a  given  plan¬ 
ning  system  makes  possible.  Thus  rehearsal  can  be  considered  a 
technique  to  assess  a  plan's  suitability  by  taking  into  account 
significant  factors  such  as  c.g.,  tactics,  threats,  deconfliction 
etc.,  and  for  the  planner  to  develop  confidence  in  the  plan. 

The  time  available  and  the  type  of  man-system  collaboration  are 
considered  differently  when  the  ojrcrational  need  for  rehearsal 
after  the  mission  has  been  planned  are  considered.  A  simple 
model  which  de.scribes  the  interdependency  between  these  two 
l.ictors  can  be  defined.  The  mixlel  is  based  on  three  dimensions, 
h.gh,  mixieratc  and  low  lime  constraints  and  the  modality  of  tlie 
s>  ^icm-planner  cooperation. 

W1  en  time  pressure  is  low,  the  modality  of  the  interaction  be 
iwc  m  the  system  planning  may  be  high.  Tfic  automated  support 
can  li.us  be  modeled  accordingly  e  g.,  by  allowing  the  planner  to 
assign  tasks  on  line  and  by  allowing  him  full  control.  Rehearsal 
is  therefore  implicit  in  ihe  process,  since  the  ojx’rator  is  self 
paced. 

Where  the  time  pressure  is  moderate,  automated  support  can  be 
configured  to  offer  pre-solutions  based  on  constraints  imposed 
by  the  planner  As  a  consequence,  rehearsal  capabilities  may 
concern  specific  critical  mission  pha.ses  of  the  mission. 


Where  time  pressure  is  low  or  moderate,  the  planner  is  directly 
involved  in  the  planning  piocess  and  the  system  provides 
rehearsal  facilities  where  required.  After  the  mission  has  been 
planned,  rehearsal  may  take  place  on  the  ground  before  take-off 
or  during  tlie  flight,  during  either  time  pressure  may  be  high  and 
operator  system  interaction  may  be  low.  As  a  result,  the  auto¬ 
mated  system  may  be  configured  to  undertake  most  of  the  plan¬ 
ning  task. 

This  simple  model  is  aimed  al  describing  features  that  may  be 
implemented  into  an  MRS  in  order  to  support  rehearsal. 
Mission  review,  where  a  mission  is  "re  flown  "  to  review  aspects 
of  the  mission  may  be  another  function  of  the  rehearsal  process. 
Another  im|xirtant  characteristic  is  the  level  and  quality  of  "real¬ 
isin'  that  is  considered  necessary.  Where  realism  is  critical  full 
simulation  facilities  may  be  necessary  e  g..  L'S  3l)F  MRS.  The 
cost  of  such  rehearsal/mi.ssion  I'laiining  systems  will  ensure  that 
are  employed  only  for  those  missions,  (or  pans  of  missions), 
where  such  a  level  ol  fidelily  is  tequired, 

3.7  INTI  I.IJCENT  IT  TOR  eSr  TRAIMNC  .SYSTEMS. 

The  training  requitcmerUs  .issociaied  w  ith  the  emerging  MRS 
have  noi  been  addressed.  One  reasim  may  be  tliai  planners  do 
not  see  the  need  for  an  iinesimem  in  training  as  the  design  of 
fulute  inlerl.ices  should  enable  llie  operalion  w  ithout  the  need  to 
use  specific  trained  skills. 

However,  .some  form  of  user  helji  in  tlie  form  of  "intelligent 
assistance'  may  be  n-qiiired.  The  assistance  should  be  modeled 
on  the  user's  p.isl  interaction.s  with  the  system.  Such  "intelligent 
tutors"  may  be  envisioned  .is  personal  tools  for  assessing  capa- 
bililies.  es.ilnaling  re.csoning.  ecalualmg  progress  etc. 

The  deveh'pnient  of  compuier  aided  iiistriiclion  represents  an 
iiiijiorianl  siep  toward  the  realization  of  "intentional  systems". 
Such  systems  arise  naliirally  from  .idaplive  interfaces.  Concepts 
such  as  DWIM  tDo  What  I  Me.uil  are  im[xiriant  in  sjxrc’dmg  the 
planning  process  wilhoiil  s.tcrificing  accuracy  . 

The  input  of  the  mission  planner  is  m  the  fonn  of  simple  com¬ 
mands  which  aclivaie  prep.ickaged  models  of  interaction.  These 
are  able  to  infer  die  required  .ictions  needed  to  earry  out  the  sub 
tasks  The  design  of  such  inlcTligenl  assistance  is  a  major 
challenge  to  future  MR.S  design  as  it  requires  harmonization 
Knween  the  dominant  technology  diiven  design  process  and  the 
underslandiiig  of  die  users  needs. 


Chapter  4 

Man/Machine  Interface  Technologies; 


4.1  DISPLAYS  AND  GRAPHICS. 

4.1.1  Introduction. 

For  all  types  of  mission  planning  and  mission  rehearsal  equip¬ 
ment  the  presentation  of  information  to  human  operators  is  a  key 
element  in  the  total  system  design;  this  is  equally  applicable  to 
equipment  used  on  the  ground,  such  as  computer-based  work¬ 
stations,  and  equipment  installed  as  part  of  the  avionics  suites  of 
military  aircraft.  Of  the  ways  in  which  information  can  be  pre 
sentcd  to  human  operators,  visual  presentation  is  by  far  the  most 
useful  since  it  is  interrogated  by  a  sensor  ■  the  eye  -  which  can 
accept  and  interpret  a  much  higher  rate  of  information  flow  than 
any  of  the  other  human  sensors.  This  section  is  devoted  to  an 
analysis  of  the  various  factors  which  are  important  to  the  design 
of  display  systems  for  mission  plarming  systems,  together  with 
an  assessment  of  the  present  state-of-the-art  in  such  display  sys¬ 
tems.  It  concludes  with  recommendations  for  the  research  and 
development  which  will  be  necessary  in  order  to  achieve  the  ad¬ 
vancements  in  display  technology  which  are  likely  to  be  most 
useful  in  fumre  mission  planning  and  rehearsal  systei 

A  display  system  for  a  mission  planning  system  can  be  consid¬ 
ered.  in  its  simplest  form,  as  consisting  of  the  three  elements 
shown  in  Figure  4-1.  There  must  first  be  a  store  of  information, 
a  database,  which  contains  all  of  tlie  information  which  may 
need  to  be  presented  to  the  operator.  Then  there  must  be  a  pro¬ 
cessor  which,  upon  command  from  the  operator,  selects  the 
ap[.xopnate  data  from  the  database  and  re  formats  it  so  that  it  is 
in  a  form  which  can  be  input  to  the  display.  The  third  element  is 
the  display  itself  which  transfomis  the  output  from  die  proces.sor 
into  a  pattern  on  a  display  screen  so  that  it  can  be  seen  and 
understood  by  die  ojvcrator  using  his  eyes  as  sensors. 

The  information  displayed  in  mi-ssion  planning  di-spiays  is  usu 
ally  of  two  types,  alpha-numeric  li  e.,  letters  and  numbers)  and 
graphic  (i.e.  picUmal).  In  some  formats,  such  as  maps,  a  combi¬ 
nation  of  these  is  shown  Because  the  presentation  of  alpha¬ 
numeric  information  is  relatively  easy  compared  with  that  of 
graphical  and  combined  information,  only  these  latter  will  be 
considered  in  this  chapter.  Tlie  prtKcssor  of  Figure  4- 1  is  then 
of  a  special  type  often  known  as  a  graphics  processor  or  image 
generator 

Tlie  three  elements  in  Figure  4-1  form  a  chain  along  which 
information  is  pa.ssed,  the  chain  continuing  lo  include  ihe  opera 
tor's  eye;  as  its  Final  link  (the  further  c.slension  lo  the  brain  is 
not  discussed  in  this  section).  To  allow  this  chain  to  perform 
effectively  it  is  important  that  the  characteristics  of  each  of  the 
elements  shall  be  reasonably  well  matched.  Thus,  for  esample. 
there  would  be  no  value  in  displaying  information  at  a  higher 


spatial  resolution  than  can  be  resolved  by  the  eye  since  much  of 
that  information  would  necessarily  be  lost.  Equally,  if  the  dis¬ 
played  information  is  of  very'  low  resolution,  the  potential  of  the 
eye  as  a  receptor  of  information  is  not  being  used  to  full  advan¬ 
tage,  and  in  addition  some  discomfort  may  be  caused  to  Ihe 
viewer. 

The  designer  of  the  chain  can  specify  the  characierislics  of  each 
of  ihc  three  elements,  within  limiLs  set  by  the  available  technol¬ 
ogy,  to  sun  the  particular  requiremenLs  of  the  mission  planning 
syslem.  The  characierislics  of  ihe  operautr's  eyes  are.  however, 
already  fi.xed  and  hence  musi  dominate  the  design  of  the  cham 
and  ultimately  affect  each  of  the  elements.  For  this  reason  these 
features  are  described  briefly  in  the  fullowiiig  jcclion. 

The  eye's  performance  as  a  receptor  of  Ihe  visual  scene  is  ex¬ 
tremely  complex  and  only  an  milline  description  is  eiven  here; 
for  more  detail  the  reader  is  rcterred  to  the  many  texts  (e.g., 
14.1 1  on  the  sub)ecl.  In  the  context  of  the  design  of  display  sys¬ 
tems  the  follow  ing  ,ire  the  most  important  eharacteristies; 

•  Ke.solution /' .-\euily 

•  Sciisilisiiy  to  Brightness 

•  Sensitivity  to  Color 

•  Sertsiiivity  to  Contrast 

•  Scn.siiis  ity  to  Flisker 

•  Field  o!  Vi.'w 

•  Steteopsis 

Many  of  tliese  eharaeterisiK s  are  imenel.ited.  For  ev.aniplc  the 
sensitivities  to  color,  to  eomr.isi  and  lo  llieker  .ite  .dl  strongly  af¬ 
fected  by  Uie  level  ol  brightness  ol  ihe  perseised  scene. 

The  ability  ol  the  eye  to  resoise  detail  is  of  p.iiticulai  imiiot 
tarke.  Figure  4  2  is  lypie.i)  oi  tlie  (vrlorni.ini  e  which  has  been 
measured  using  normal  healthy  suh|eet.s;  it  shows  t)ie  eye’s  reso 
lulion  as  a  function  of  the  oser.ill  illumination  I'f  the  visual 
scene  For  i'h|s'cLs  close  lo  the  s  isu.il  avis  of  die  eye  the  re.solu- 
tioii  at  brighuioss  levels  of  1  vd  in  '  is  aNiut  D.d.'i  mr  (abviut  1 
minute  of  arc),  this  ev'rrosp.mds  to  the  eoiidituin  of  the  image 
being  liieiisevl  ujioii  an  area  ot  the  retina  wholly  [xipulated  by 
cones  The  resolution  Fills  oil  sic.elily  from  ihis  eciural  condi- 
lioii  until.  .11  .'()'  off-axis  where  the  relina  is  (lopulaled  cnlircly 
by  rods,  the  lesolulion  is  only  .ilsout  1(1  mr  (about  i()  minutes). 
This  (XTipheral  vision  is  achieved  ,il  lower  brightness  levels,  is 
insensitive  to  color,  and  is  more  sensitive  to  flicker  lh.an  the 
central  region. 


Figure  4-1.  The  Display/Graphics  .System 
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Most  displays  appropriate  for  mission  planning  will  be  designed 
to  match  the  flat  part  of  the  central-region  curve,  so  that  a  dis¬ 
play  resolution  of  better  than  1  mr  should  be  specified.  This 
resolution  is  normally  required  over  the  whole  of  the  display  be¬ 
cause,  although  the  eye's  resolution  falls  off  progressively  away 
from  the  central  region  of  about  100  mr  diameter,  eye  move¬ 
ment  and  head  movement  are  usually  used  by  the  observer  to 
image  any  required  part  of  the  display  onto  the  center  of  the 
retina. 

Flicker  sensitivity  is  important  because,  with  electronic  displays, 
the  patterns  written  on  the  display  surface  must  be  periodically 
refreshed;  if  the  refresh  rale  is  sufficiently  frequent  the  eye  sees 
a  steady  display,  whereas  if  it  is  relatively  infrequent  the  display 
will  appear  to  flicker.  A  refresh  rate  of  60  frames  per  second  is 
usually  specified  and  under  most  visual  conditions  this  will  be 
sufficient  to  prevent  any  perception  of  flicker. 

Field-of-View  of  the  eye  itself  may  not  be  particularly  important 
because  of  the  rapid  movements  of  the  eyes  within  the  head,  and 
the  rather  slower  movements  of  the  head  itself.  Thus  in  design¬ 
ing  most  displays  it  is  assumed  that  these  movements  are  taking 
place  even  though  the  display  surface  may  not  subtend  a  very 
large  angle  at  the  eyes,  since  the  eyes'  optical  axes  are  usually 
directed  to  areas  of  interest  where  the  maximum  resolving 
power  is  needed.  For  mission  rehearsal,  where  the  visual  scene 
may  need  to  simulate  that  seen  from  the  actual  aircraft,  it  can  be 
important  to  use  displays  with  very  large  angular  subtends  in  or¬ 
der  to  create  images  which  are  seen  peripherally. 

Stereopsis  is  the  ability  to  judge  three-dimensional  scenes  using 
the  different  images  seen  by  the  two  eyes  of  the  observer.  Some 
work  (e.g.,  [4.2])  has  been  done  to  assess  the  use  in  simulators 
of  displays  which  create  a  stereoscopic  effect  by  presenting  dif¬ 
ferent  images  to  the  two  eyes,  but  their  value  has  not  been  es¬ 


tablished  and  few  such  displays  have  been  used  in  operational 
flight  simulators.  Stereopsis  will  not  be  considered  further. 

4.1.2  Map  Displays  for  Mission  Planning. 

4. 1.2. 1  Introduction. 

The  presentation  of  a  map  on  an  electronic  display  surface  is 
normally  done  in  a  pipeline  process  which  comprises  the  three 
main  elements  shown  in  Figure  4-1,  database,  graphics  genera¬ 
tor  and  display.  The  problem  is  greatly  simplified,  as  compared 
with  the  generation  of  perspective  displays  which  will  be  dis¬ 
cussed  later,  by  the  fact  that  maps  of  the  terrain  and  of  terrain 
features  are  two  dimensional.  Once  the  map  has  been  trans¬ 
formed  from  databse  coordinates  into  display  coordinates,  fur¬ 
ther  geometric  transformation  requires  only  the  following: 

•  Scaling 

•  Slewing  in  two  horizontal  directions 

•  Rotation  about  a  vertical  axis. 

The  graphics  generator  may  also  be  required  to  create  symbol¬ 
ogy  which  may  move  fairly  rapidly  around  the  screen,  but  even 
allowing  for  this  requirement,  the  task  can  be  fairly  easily  met 
by  many  microprocessor-based  computers  which  are  widely 
available  in  workstations.  In  addition,  for  map  displays  used  in 
future  aircraft,  the  power  of  airborne  computers  is  likely  to  be 
such  that  they  can  readily  produce  any  type  of  map  and  graphics 
format  required. 

The  principal  difficulties  in  generating  electronic  map  displays 
therefore  arise  within  the  other  two  parts  of  the  pipeline,  i.e.  in 
the  creation  of  appropriate  databases  and  in  the  design  of  the 


Figure  4-2.  Eye  Rc.solutinn. 


displays  themselves.  These  two  areas  are  described  in  detail  in 
the  following  sections. 

4.12.2  Databases  for  Ground-Based  Map  Displays. 

Digital  Databases  are  now  becoming  available  in  many  coun¬ 
tries.  and  are  being  produced  by  both  civil  and  military  authori¬ 
ties  as  well  as  by  industry.  Although  much  of  the  data  is  avail¬ 
able  in  formats  which  do  not  correspond  to  any  internationally- 
agreed  standards,  such  data  can  generally  be  readily  transformed 
off-line  into  whichever  formats  are  being  used  for  individual 
applications.  Prominent  among  the  digital  data  available  are  the 
US  DTED  (Digital  Terrain  Elevation  Data)  and  DEAD  (Digital 
Feature  Analysis  Data),  which  can  be  provided  in  a  range  of  dif¬ 
ferent  scales  and  accuracies,  the  most  detailed  corresponding  to 
that  of  a  1:50,000  scale  map.  This  is  almost  invariably  suffi¬ 
ciently  accurate  for  mission  planning  unless  pin-point  accuracy 
relative  to  individual  buildings  is  required. 

Mission  planning  requires  that  this  data  contains  all  the  features 
which  can  affect  the  safety  and  success  of  the  mission,  and  u  is 
in  this  area  that  the  most  problerns  can  arise.  In  a  peacetime 
scenario  it  is  unlikely  that  the  data  will  be  reliably  updated  in 
terms  of  power  lines  or  other  tall  man-made  features.  In  a 
wartime  scenario,  updating  may  be  needed  at  frequent  intervals 
to  incorporate  the  positions  of  friendly  and  enemy  assets;  such 
information  is  generally  provided  from  intelligence  sources  and 
is  unlikely  to  be  in  a  form  compatible  with  the  digital  database 
information.  Thus,  to  input  intelligence  information  into  a  mis¬ 
sion  planning  system  generally  requires  significant  manual  op¬ 
erations.  Future  mission  plarming  systems  should  provide  the 
automation  of  this  function  to  allow  better  integration  into  the 
C^I  network. 

4.12.3  Databases  for  Airborne  Map  Displays. 

For  airborne  map  displays  to  be  used  for  mission  planning  pur¬ 
poses,  the  required  database  information  is  generally  no  more 
detailed  than  for  the  ground-based  systems  discussed  above. 
However,  the  problem  of  updating  is  significantly  aggravated 
since  the  aircrew  (unless  the  aircraft  is  a  command-and-control 
center  such  as  AW  ACS)  is  unlikely  to  have  sufficient  time  for 
updating  manually  using  intelligence  information.  Thus  it 
seems  likely  that,  except  for  very  simple  updates,  the  database 
must  remain  unchanged  throughout  the  mission.  For  future  sys¬ 
tems  updating  of  tactical  databases  via  a  data  link  will  probably 
be  considered  mandatory. 

4.12.4  Display  Devices  for  Ground-Based  Map  Displays 

Electronic  displays  of  map  information  which  are  to  be  used  on 
the  ground  are  almost  invariably  in  a  reasonable  environment  in 
which  a  fairly  large  display  screen  can  be  used  and  the  ambient 
light  level  can  be  well  controlled.  This  is  also  true  of  displays  to 
be  used  in  airborne  command-posts  such  as  the  AW  ACS  type  of 
aircraft. 

If  maps  are  to  be  created  which  have  a  quality  even  remotely 
approaching  that  of  conventional  paper  maps,  the  only  technol- 
ogy  which  is  currently  available  is  the  Cathode  Ray  Tube 
(CRT).  The  principal  commercial  application  for  high  quality 
cathode  ray  tubes  is  that  of  engineering  des.gn,  using  Computer- 
Aided-Design  (CAD)  techniques,  and  this  ipplication  has  pro¬ 
vided  the  business  incentive  to  advance  the  state-of-the-art  in 
high  quality  CRTs  in  the  past  decade.  Although  alternative 
technologies,  such  as  liquid  crystals,  have  also  made  notable 
improvements,  it  seems  unlikely  that  they  can  senously  chal¬ 


lenge  CRTs  in  the  foreseeable  future.  A  typical  high-quality 
CRT  intended  for  CAD  use  might  have  the  following  principal 
characteristics; 

•  Full  color  (by  using  a  screen  with  3-color  triads) 

•  Size  400mm  horizontal,  300mm  vertical 

•  Raster  pattern  (approx.)  1200  pixels  per  line,  1000  lines. 

The  total  number  of  individual  pixels  (picture  elements)  which 
can  be  displayed  is  about  one  million,  and  if  refreshed  at  60  Hz 
to  avoid  apparent  flicker,  a  video  clock  speed  of  about  100  MHz 
is  necessary,  which  is  currently  possible  with  suitable  drive  cir¬ 
cuitry.  These  circuits  are  now  available  as  graphics  cards  which 
themselves  contain  significant  computing  power  and  memory  to 
off  load  much  routine  computation  from  the  main  graphics 
computer.  If  the  map  scale  is  changed,  or  the  map  needs  to  be 
rapidly  slewed,  the  response  may  be  a  little  slow,  but  this  is  not 
normally  seen  as  a  significant  problem  in  use. 

A  CRT  of  this  size,  when  viewed  at  a  typical  workstation  dis¬ 
tance  of  400  mm,  will  generate  pixels  which  each  subtend  about 
0.75  mr  at  the  user's  eyes;  this  is  rather  larger  than  the  resolu¬ 
tion  of  the  eye,  and  hence  the  raster  structure  of  the  map  display 
will  be  seen,  and  the  picture  will  not  appear  as  clean  and  sharp 
as  with  a  good  quality  paper  map.  However,  such  displays  do 
appear  to  be  adequate  for  use  in  mission  planning  systems. 
Moreover,  the  advantages  of  an  electronic  map,  such  as  ability 
to  change  scale,  slew,  rotate  and  select  types  of  feature,  are  such 
that  the  map  displays  will  inevitably  be  electronic  in  all  current 
and  future  systems. 

It  is  likely  that  future  CRT's  w  ill  be  able  to  provide  further  in¬ 
creases  in  resolution  and  size.  Displays  of  2500  pixels  and  2(XX) 
lines  in  sizes  up  to  500  mm  by  500  mm  are  already  in  produc¬ 
tion.  although  they  are  not  yet  available  to  military  standards. 
As  high  definition  television  becomes  established,  a  sufficient 
market  may  be  created  to  force  prices  of  high  quality  displays 
(including  the  associa.wd  vicctronjcs)  to  fall  significantly.  This 
market  may  also  provide  the  stimulus  for  the  development  of 
alternatives  to  the  CRT,  particularly  for  large  screens  designed 
for  simultaneous  viewing  by  numbers  of  persons. 

4.1 .2.5  Display  Devices  for  Airborne  Map  Displays. 

The  problems  associated  with  displaying  maps  in  the  cockpit  of 
a  military  aircraft  are  considerable.  Firstly,  the  size  and  position 
available  for  the  display  are  far  from  optimum,  the  screen  size 
being  typically  about  125  mm  by  125  mm  and  the  screen  posi¬ 
tion  being  below  or  to  the  side  of  the  central  head-up  display 
which  inevitably  lakes  the  prime  position  in  the  pilot's  field-of- 
view  s.Tondly,  the  cockpit  transparency  ensures  that  a  high 
level  of  ambient  light  will  often  be  present,  and  that  sunlight  can 
often  shine  directly  onto  the  front  surface  of  the  screen.  Thirdly, 
there  may  be  significant  vibration  in  the  cockpit  which  will 
affect  the  resolution  performance  of  the  pilot's  eyes. 

Although  some  current  map  displays  use  optical  projection  sys¬ 
tems  to  reduce  the  effects  of  ambient  light  anc  of  vibration, 
modem  practice  is  to  provide  very  bright  displays  which  arc 
viewed  directly.  Such  displays  usually  have  much  lower  pixel 
performance  than  workstation  displays;  typically  a  raster  pattern 
of  512  lines  each  of  512  pixels  is  used.  It  may  also  be  noted  that 
the  color  performaiKe  is  seriously  affected  by  the  strong  ambi¬ 
ent  light  and  by  very  low  brightness  adjustment  (night  opera¬ 
tions)  so  that  color  discrimination  by  the  pilot  is  degraded. 
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Much  effort  has  recently  been  devoted  to  the  improvement  of 
color  displays  for  cockpit  use  and  new  techniques  are  beginning 
to  come  into  use.  particularly  liquid  crystal  displays,  which  in 
some  respecLs  give  performance  improvement  over  CRT's. 
Particular  areas  of  improvement  are  size  and  brightness,  the  lat¬ 
ter  providing  improved  color  rendition  in  high  ambient  illumina¬ 
tion.  But  it  is  certain  that  the  overall  performance  will  always  be 
considerably  below  that  of  ground-based  displays. 

At  the  other  end  of  the  ambience  scale  -  night  time  operations  - 
there  is  a  different  problem  which  arises  if  the  pilot  is  wearing 
night  vision  goggles.  These  will  significantly  compromise  his 
ability  to  perceive  detail  on  a  map  display  because  they  are 
monochrome  and  have  a  resolution  capability  far  below  that  of 
the  human  eye. 

Perhaps  of  mote  importance  than  display  performance  is  the  fact 
that  a  pilot  must  necessarily  divide  his  time  between  several 
tasks  and  hence  will  not  be  able  to  concentrate  his  attention  on 
an  airborne  map  display  for  long  periods  at  a  time.  Taken  to¬ 
gether  with  the  performance  limitations  already  noted,  the  result 
is  that  display  formats  have  to  be  designed  to  be  much  more 
simplistic  with  a  lower  information  content  than  those  intended 
for  ground  use.  and  for  this  reason  the  design  of  airborne  display 
formats  has  received  much  attention  over  many  years.  It  is  clear 
that  the  use  of  mission  planning  systems  in  the  cockpits  of  fu¬ 
ture  tactical  aircraft  could  be  significantly  limited  by  the  simple 
formats  that  will  have  to  be  provided  on  their  map  displays. 

4.1  J  Perspective  Displays  for  \Hs.sion  Planning/Rehear.sal. 
4  13  1  Introduction 

The  generation  and  display  of  perspective  scenes  is  a  much 
more  complea  and  difficult  problem  than  that  of  maps;  the  four 
main  reasons  for  this  are: 

1)  The  geometric  transformations  which  relate  the  dis¬ 
played  view  to  the  terrain  coordinate  set  can  have  six 
independent  degrees  of  freedom  as  compared  with 
only  three  for  a  map  which  is  constrained  to  the  hori¬ 
zontal  plane. 

2)  If  the  display  is  to  be  used  for  real-time  mission  re¬ 
hearsal.  It  is  probable  that  the  angular  transformations 
will  correspond  to  the  orientation  of  the  aircraft  rela¬ 
tive  to  the  ground  plane,  and  hence  the  maximum  an¬ 
gular  rates  at  which  these  transformations  need  to  be 
varied  must  match  the  very  high  speeds  of  angular  ro¬ 
tation  which  can  be  achieved  by  military  combat  air¬ 
craft.  This  problem  becomes  significantly  more  severe 
with  the  advent  of  helmet  mounted  and  eye-slaved 
displays. 

3)  The  detail  in  the  scene  may  be  required  to  be  much 
greater  than  in  a  map.  particularly  if  the  display  is  to  be 
used  for  mission  rehearsal. 

4)  The  field-of-vicw  of  the  display,  as  seen  from  the 
pilot's  eye  position,  may  be  much  greater  than  for  a 
map  display. 

For  these  reasons  no  system  has  yet  been  constructed  which 
generates  a  display  which  fully  matches  the  visual  scene  as  seen 
by  a  pilot  flying  a  fairly  low-level  mission  in  a  military  aircraft. 
Nevertheless,  the  state-of-the-art  has  developed  steadily  during 
the  past  decade,  so  that  images  can  now  be  generated  in  training 
simulators  which  are  sufficiently  close  to  the  real-world  scene  to 
allow  training  to  be  carried  out  effectively.  It  should  be  empha¬ 
sized,  however,  that  there  appears  to  be  no  rigorous  experimen¬ 
tal  or  theoretical  basis  which  establishes  the  degree  of  visual  fi¬ 


delity  necessary  for  different  specific  training  tasks.  Thus  the  vi¬ 
sual  characteristics  for  training  simulators  are  usually  based  on 
previous  experience  of  how  well  a  similar  task  could  be  per¬ 
formed  with  earlier  equipment,  and  also  on  the  cost  of  the  latest 
visual  equipment  available.  As  costs  of  computers  have  fallen, 
there  has  been  a  tendency  for  improved  visual  performance  to  be 
specified,  even  though  the  need  for  this  has  not  been  established 
in  any  exact  way. 

For  future  mission  rehearsal  systems  there  is  effectively  no  pre¬ 
vious  experience  on  which  to  base  decisions  on  the  requirements 
for  display  characteristics,  and  it  seems  highly  desirable  that 
experimental  research  be  directed  at  establishing  relationships 
linking  display  performance  and  rehearsal  effectiveness. 
However,  it  seems  reasonable  to  assume  that  for  those  missions 
in  which  the  pilot  is  relying  heavily  on  interpretation  of  the 
detailed  visual  seen-'  (e  g.  in  an  attack  upon  a  ground  target 
which  is  identified  visually  )  the  visual  scene  should  be  as  close 
to  reality  as  possible.  It  is  clear  that  there  are  potential  dangers 
in  rehearsing  a  mission  with  incorrect  or  inadequate  visual  cues, 
especially  in  parts  of  the  mission  such  as  target  acquisition  when 
such  clues  are  likely  to  be  at  the  limits  of  the  pilot's  eye  resolu¬ 
tion.  It  may  also  be  remarked  here  dial  many  simuhrior  displays 
operate  at  such  low  light  levels  tiiat  die  resolution  of  the  pilot’s 
eyes  is  significantly  wor.se  than  in  a  high  brightness  real-world 
situation.  Hence  detection/  ideruiricalion  ranges  in  simulation 
may  be  quite  different  from  reality,  widi  corresponding  differ¬ 
ences  in  (K'rfonnance  and  wnrk  loath 

In  the  discussion  that  follows,  a  iow-fiying  mission  will  be  ana¬ 
lyzed  and  the  demands  of  creating  appropriately  detailed  visual 
scenes  will  be  examined.  It  w  ill  be  shown  that  the  problems  in¬ 
herent  in  generating  displays  which  fully  represent  the  pilot’s 
view  of  the  real  world  are  such  that  dicse  displays  are.  for  the 
present,  iniirossible  to  manidaclure.  It  is  not  yet  clear  whether 
or  not  mission  rehearsal  systems  using  displays  ol  a  lower  stan¬ 
dard  will  provitie  effective  rehearsal  performance. 

43  t  2  PrMtuutl  Sfccijii  utions. 

It  has  been  miled  in  4. 1.3.1  above  that  no  real  basis  exists  for 
deciding  the  required  pcrform.ince  for  a  visual  display  system 
for  a  mission  rehearsal  simulauir.  .ind  also  dial  for  various  rea 
sons  a  fully  representative  scene  is  beyond  the  eapahiliiies  of 
any  system  thus  far  develoj-ied  Hence  some  compromise  m'isl 
be  reached.  Three  of  the  key  questions  which  need  to  be 
addres.scd  in  making  this  compromise  are  shown  m  the  decision 
tree  in  Figure  4  3,  and  the  answers  have  to  be  assessed  in  terms 
of  their  effects  upon  the  components  in  the  system  chain  as 
shown  in  Figure  4  1  The  questions  are: 

1)  Is  real  lime  representation  required'.’  The  answer  to 
this  question  has  a  strong  influence  upon  the  speed  at 
which  the  computations  in  the  graphics  generator  are 
carried  out,  and  if  slow  sireed  or  "snap-shot"  repro¬ 
duction  of  the  visual  scene  is  acceptable  the  cost  and 
complexity  of  the  image  generator  are  significantly 
rctluced, 

2)  l.s  hands-on  capability  rerjuired  in  the  rehearsal  simula¬ 
tion?  The  significance  of  this  question  is  that  if  the 
pilot  is  to  have  the  freedom  to  steer  the  aircraft  through 
the  simulated  visual  scene,  the  display  must  be  capable 
of  showing  the  scene  from  any  position  and  any  atti¬ 
tude.  This  precludes  the  use  of  "pre-computed"  scenes 
which  can  be  stored  and  retrieved  at  the  required  real¬ 
time  rate.  This  again  has  a  strong  influence  upon  the 
complexity  of  the  image  generator. 
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Figure  4-3.  Visual  Display  Rcquiremenls  for  Mission 
Rehearsal  Simulators. 


3)  Is  true  scene  detail  required?  As  there  is  no  virtue  in 
displaying  a  visual  scene  with  more  detail  than  the 
pilot's  eyes  can  resolve,  this  question  effectively  asks 
whether  scene  detail  matching  his  resolution  is  re¬ 
quired.  The  answer  has  implications  for  each  of  the 
elements  of  the  system  chain. 

There  are  many  system  options  which  can  be  chosen  in  response 
to  these  questions;  these  will  depend  strongly  on  the  type  of 
mission  and  also  on  the  availability  of  data  to  construct  the 
database  which  is  holding  all  the  information  necessary  to  gen¬ 
erate  the  visual  scene.  The  information  content  in  the  earth's 
visual  scene  is  much  greater  than  in  specific  man-made  targets 
such  as  aircraft.  Thus  the  difficult  missions  to  simulate  arc  those 
in  which  the  pilot  has  a  good  view  of  terrain  detail  from  a  low 
level. 

In  a  fixed-wing  low-level  ground  attack  mission,  the  most  criti¬ 
cal  phase  and  abo  the  most  difficult  to  simulate  is  that  of  target 
recognition  and  identification.  Some  simple  calculations  on  the 
resolution  requirements  illustrate  the  problems. 

If  the  aircraft  is  flying  parallel  to  a  horizontal  ground  plane  at  a 
height  h,  with  the  pilot's  sight  line  depressed  below  the  horizon 
by  6,  and  if  the  angular  resolution  of  his  eyes  is  r,  then  his  per¬ 
ceived  linear  resolution  at  the  ground  is: 

•  Vertical  Resolution  =  rh/sin0cos6 

•  Horizontal  Resolution  =  rh/sin^  0 

The  following  values  may  be  considered  as  representative: 


•  Height  above  ground  =  h  =  1 00m. 

•  Angular  depression  =  0  =  10° 

•  Eye  Resolution  =  r  =  0.5  mr 

which  result  in  the  following  values  of  linear  resolution: 

•  Vciiical  Resolution  at  the  ground  =  0.3m. 

•  Horizontal  Resolution  at  the  ground  =  1.7m. 

It  would  be  almost  impossible  to  create  a  database  covering  an 
area  representative  of  a  typical  target  area  containing  terrain  and 
feature  detail  equivalent  to  these  values  of  resolution,  and 
equally  impossible  to  generate  detailed  images  from  it;  further 
consideration  of  the  implications  are  given  in  sections  4. 1.3 .3 
and  4. 1.3.4. 

The  third  element  in  the  visual  system  chain  of  Figure  4-1  is  the 
display  device;  if  this  is  to  match  the  eye  resolution  value  used 
above  then  the  individual  pixels  on  the  display  screen  must  have 
similar  angular  resolution  at  the  pilot's  eyes.  Thus  for  a  typical 
high  resolution  color  CRT  having  about  1500  horizontal  pixels 
the  total  horizontal  ficld-of-vicw  as  seen  by  the  pilot  would  be 
about  0.75  radians  or  40°.  A  display  of  this  size  would  probably 
be  sufficient  for  the  target  acquisition  task,  but  would  not  be  ad¬ 
equate  to  provide  the  pilot  »  ith  all  the  wider  field-of-view  cues 
which  are  necessary  to  properly  perform  the  total  flying  task. 

The  difficulties  of  providing  adequate  visual  scenes  in  simulat¬ 
ing  fixed-wing  operation  close  to  the  ground  become  even 
greater  in  the  ctise  of  he'l-ttprers  There  an.  >everal  reasons  for 
this,  the  principal  one  is  that  operation  can  be  evert  closer  to  the 
ground  than  at  the  height  of  UKlm  quoted  above.  It  should  also 
be  noted  that  the  crew  is  likely  to  be  looking  down  through  a 
greater  depression  angle  than  in  the  fixed  wing  case,  perhaps 
down  at  20°or  30°  to  the  horizontal. 

Using  the  same  expressions,  hut  with  values  of  h=20m  and 
0=  30°,  tltc  correspr'iding  values  of  [Xtreeived  resolution  are: 

•  Vertical  resolution  at  the  ground  =  0.025m. 

•  Horizontal  resolution  at  the  ground  =  0.04m. 

These  are  such  small  values  as  to  make  it  almost  impossible 
ever  to  create  moving  visual  scenes  of  this  magnitude  of  detail. 
Perhaps,  in  the  future,  it  might  be  jxissible  for  very  small  indi¬ 
vidual  fcaliircs  such  as  buildings. 

Another  major  difficulty  with  the  simulation  of  helicopter  opera¬ 
tion  is  that  because  the  vehicle  can  have  quite  small  ground 
speed,  the  crew  will  kxik  around  through  a  relatively  large  arc  of 
vision,  much  larger  than  in  fixed-wing  operation.  Some  heli¬ 
copters  have  bubble  canopies  which  allow  a  visual  field  of  over 
half  the  4n  steradians  solid  angle  visible  by  a  totally  unob¬ 
structed  observer.  A  display  which  could  provide  sufficient 
pixels  to  give  resolution  of  0  5  mr  over  a  field  of  view  of  2Jl 
steradians  would  have  to  contain  some  2.5x  10^  pixels.  This  is 
much  greater  than  any  currently  available  display. 

For  these  reasons,  it  has  not,  so  far,  been  possible  to  design 
visual  simulations  of  a  quality  really  adequate  for  the  training  of 
low-level  helicopter  operations,  and  it  docs  not  seem  likely  that 
suitable  equipment  will  become  available  in  the  foreseeable 
future.  Practical  experiment!  using  cuirenlly  available  technol¬ 
ogy  are  described  in  depth  in  (4.3,  4.4).  Realistic  simulation  for 
mission  rehearsal  is  equally  difficult,  with  the  added  problem 
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that  databases  may  need  to  be  created  in  a  much  shorter  time 
scale. 

4.13.3  Databases  for  Perspective  Displays. 

The  creation  and  updating  of  databases  for  perspective  displays 
is  potentially  one  of  the  most  difficult  aspects  of  advanced  mis¬ 
sion  planning  and  rehearsal  systems,  particularly  if  the  display 
to  be  gerterated  is  to  give  a  picture  which  is  visually  close  to  that 
of  the  rfal  world.  As  discussed  in  previous  sections,  the  v.'crst 
case  is  for  tactical  aircraft  and  helicopters  operating  close  to  the 
ground,  because  the  required  scene  detail  is  much  greater  than 
for  map  displays,  and  this  requirement  forms  the  basis  for  the 
discussion  which  follows. 

High  resolution  databases  may  be  built  up  from  the  following; 

1)  Standard  databases  such  as  DF AD  and  DTED. 

2)  Reconnaissance  Data  from  aircraft  and  satellites,  usu¬ 
ally  in  the  foim  of  images. 

3)  Libraries  of  standard  features  and  textures  which 
approximate  to  the  features  and  textures  in  the  actual 
scene  being  recreated. 

4)  Intelligence  data. 

The  extent  to  which  standard  features  and  textures  can  be  used 
instead  of  specifics  depends  very  largely  upon  the  height  of  the 
operating  aircraft  and  the  use  to  which  recognition  of  the  scene 
is  being  put;  in  target  areas  it  may  be  found  inappropriate  to  use 
them  because  they  will  be  insufficiently  representative  of  the 
real  world. 

The  building  of  a  complete  database  from  these  four  types  of 
data  can  be  a  difficult  process.  Amongst  the  reasons  for  this  are: 

1)  The  scale,  resolution  and  coordinate  bases  of  the  stan¬ 
dard  digital  data  may  not  be  the  same. 

2)  Image  data  may  have  ill-defined  coordinates  and 
totally  random  directions  of  viewing. 

3)  Image  data  may  have  been  obtained  in  different  light¬ 
ing  conditions  and  have  different  cosmetic  quality. 

4)  The  synthesis  of  feature  geometry  from  image  data  re¬ 
quires  the  combination  of  more  than  one  image  to  ob¬ 
tain  perspective  information,  or  else  the  interpretation 
of  shadow  dimensions. 

5)  Features  and  teuain  may  not  combine  together  in  a 
way  which  is  cosmetically  satisfactory. 

6)  Intelligence  data  may  be  generated  in  a  variety  of 
forms  which  are  likely  to  be  incompatible  with 
database  standards. 

7)  Information  provided  from  different  sources  may  be 
inconsistent.  Inconsistencies  between  the  completed 
mission  rehearsal  perspective  database  and  the  simpler 
map  database  used  for  other  mission  platming  func¬ 
tions  could  cause  major  problems  during  the  overall 
planning  process. 

For  these  reasons  there  is  inevitably  a  large  amount  of  skilled 
manpower  involved  in  the  creation  of  a  database  suitable  for  the 
simulation  of  a  low-level  scene  of  a  complex  area  of  the  ground 
with  man-made  features  such  as  buildings.  Because  of  the 
penalties  of  including  more  scene  detail  than  necessary,  they  are 
usually  optimized  for  specific  types  of  mission  and  are  not  gen¬ 
erally  usable  at  significantly  different  heights.  Ref.  [4.S  -  4.7) 
provide  excellent  accounts  of  the  techniques  used  to  build 
databases. 


The  need  for  human  judgment  in  the  building  of  these  databases 
implies  that  this  is  done  ahead  of  the  on-line  creation  of  the  dis¬ 
played  scene  by  the  scene  generator.  However,  with  the  devel¬ 
opment  of  mission  rehearsal  systems  and  the  need  to  reduce 
database  preparation  times  as  much  as  possible,  efforts  are  being 
made  to  carry  out  part  or  all  of  the  building  during  run-time.  So 
far,  this  has  only  been  fully  done  with  workstation-based  sys¬ 
tems  in  which  DTED  and  DEAD  information  is  directly  used  in 
the  generation  of  scenes,  but  without  the  complexities  of  usmg 
additional  data  such  as  photographic  images.  However  in  the 
ESIG-4000  computer  system  being  developed  for  a  US  Air 
Force  mission  rehearsal  system,  which  uses  image  data  as  well, 
the  features  and  the  terrain  are  built  up  as  two  separate  databases 
which  are  then  combined  in  real-time;  this  is  claimed  to  give 
advantages  in  savings  of  database  preparation  time  for  which  a 
total  of  48  hours  has  been  specified  to  construct  a  database  for  a 
target  scene  which  includes  a  number  of  highly  detailed  build¬ 
ings  and  other  features. 

Databases  must  be  constructed  so  that  the  data  is  stored  in  a 
format  from  which  it  can  be  extracted  by  the  image  generator.  In 
many  cases  this  implies  that  the  format  is  specific  to  the  design 
of  the  display  generator  and,  since  most  manufacturers  have 
their  own  individual  designs  of  generators,  the  format  is  specific 
to  each  manufacturer.  As  an  example  of  these  differences,  ter¬ 
rain  data  is  sometimes  stored  in  rectangular  coordinates  and 
sometimes  by  means  of  polygons.  In  addition,  most  data  is 
stored  using  some  degree  of  data-compression,  and  again  the 
method  used  tends  to  be  company-specific.  For  the  users  these 
are  major  disadvantages  since  a  database  constructed  for  one 
display  system  cannot  be  used  for  another  without  expensive 
and  time-consuming  re-formatting.  An  initiative  has  been  taken 
by  the  US  Air  Force  with  the  Project  2851  [4.8]  which  is  trying 
to  set  standards  for  simulation  databases,  but  the  problem  is 
proving  to  be  extremely  difficult. 

All  of  the  above  discussion  has  assumed  that  the  scene  to  be 
generated  is  a  representation  of  the  pilot's  visual  scene.  For 
most  missions  which  involve  target  attack  it  is  equally  important 
to  simulate  the  scene  which  would  be  generated  by  a  sensor, 
such  as  a  FLIR,  Uxiking  forward  from  the  aircraft.  Such  scenes 
can  be  created  from  the  same  database  as  the  visual  scene  but 
need  additional  parameters  which  characterize  the  IR  behavior 
of  the  terrain  and  the  features. 

4. 1.3.4  Image  Generation. 

The  function  of  the  image  generator,  as  shown  in  Figure  4-1,  is 
to  take  data  from  the  database  and  to  construct  an  image  of  the 
visual  (or  sensor)  scene  taking  account  of  the  geometry  of  the 
aircraft  relative  to  the  terrain  coordinates.  The  output  signal  is 
fed  to  the  display  in  a  format  defined  by  the  display  characteris¬ 
tics;  usually  the  format  is  a  raster  standard  specified  in  terms  of 
the  number  of  lines,  the  frequency  or  pixel  content  of  each  line 
and  the  refresh  rale. 

Although  each  manufacturer  of  image  generators  has  his  own 
design  for  performing  this  function,  and  these  differ  in  detail, 
most  conform  in  general  layout  to  that  shown  in  Figure  4-4. 
This  fgure  shows  at  the  left  the  combination  of  data  into  an 
appropriately  formatted  database,  which  is  not  really  an  image 
generator  function  and  is  usually  carried  out  off-line,  but  which 
has  to  be  considered  as  part  of  the  overall  design  process  to 
ensure  compatibility  of  formats.  The  on-line  pipeline  system 
which  forms  the  image  generator  comprises  four  processors 
which  successively  perform  the  following  transformations; 
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Figure  4-4.  Typical  Structure  of  an  Image  Generator. 


•  The  Perspective  Processor  takes  the  database  model  and, 
using  data  concerning  the  geometry  of  the  aircraft  rela¬ 
tive  to  the  terrain,  computes  the  terrain  and  feature  ge¬ 
ometry  in  display  coordinates. 

•  The  Raster  Processor  reformats  the  perspective  geome¬ 
try  into  the  display  raster  format. 

•  The  Pixel  Processor  takes  the  raster  signal  and,  using 
depth  data  from  the  Perspective  Processor,  deletes 
information  on  surfaces  which  are  hidden  from  view  by 
nearer  surfaces.  Using  texture,  shading  and  color  data 
from  the  database  it  calculates  the  pixel  brightness  and 
color  for  each  pixel  on  the  display. 

•  The  Frame  Buffer  is  a  store  in  which  all  the  pixel  infor¬ 
mation  is  accumulated  so  that  it  can  be  read  out  at  inter¬ 
vals  determined  by  the  display  clock. 

An  estimate  has  been  given  in  section  4. 1.3.2  above  of  the  num¬ 
ber  of  display  pixels  required  to  give  a  display  which  is  really 
adequate  for  low-level  Bight,  but  this  is  beyond  the  resolution  of 
the  best  displays.  As  will  be  noted  in  4. 1.3.5,  most  raster  dis¬ 
plays  have  no  more  than  3x10*  pixels  which  need  to  be 
refreshed  at  SO  or  60  Hz  to  avoid  perceptible  Bicker,  and  thus  a 
pixel  data  rate  of  1.5x10*  per  secoiKl  is  required.  In  practice  the 
data  rate  from  even  the  most  powerful  image  generators 
cunently  available,  such  as  the  GE  Compuscene  5  and  the  E&S 
ESIG  4000  is  less  than  10*  per  second  per  charmel  so  that  paral¬ 
lel  pixel  processors  may  be  necessary.  Parallel  operation  of 
several  perspective  processors  may  also  be  required  to  provide 
adequate  throughput. 

The  operation  of  four  processors  in  pipeline  necessarily  implies 
significant  time  delay  between  a  change  of  the  input  geometrical 
data  and  a  change  in  the  displayed  image.  Top-end  systems 
have  overall  transport  delays  in  the  60-70  ms  range,  and  this  is 
only  Just  adequate  to  prevent  the  delay  becoming  perceptible  to 
the  pilot 

Although  performatKe  figures  for  high-quality,  high-cost  image 
generators  have  been  mentioned,  it  should  be  noted  that  modem 


workstations  are  now  so  powerful,  and  have  so  much  capacity 
for  operating  in  parallel,  that  they  are  beginning  to  make  signifi¬ 
cant  iiuoads  into  the  training  simulator  market.  It  is  reasonable 
to  predict  that  this  will  be  followed  by  progressive  inroads  into 
the  mission  rehearsal  area,  but  the  extent  of  this  is  difficult  to 
predict  as  there  is,  as  yet,  no  clear  agreement  on  the  display  res¬ 
olution  requirements  for  rehearsal  systems.  The  use  of  work¬ 
stations  for  rehearsal  purposes  within  a  mission  planning  system 
also  based  on  similar  workstations  has  obvious  advantages  in 
terms  of  first  cost,  compatibility  of  data  standards  and  ease  of 
maintenance  and  support. 

4.1 .3.5  Display  Devices  and  Optics. 

The  third  element  of  the  system  shown  in  Figure  4-1  is  the 
display  device  which  transforms  the  signal  from  the  image 
generator  into  a  visible  image.  Because  of  the  need  to  match  the 
eye's  characteristics,  the  image  should  ideally  be  full-color,  high 
resolution,  wide  field  cf  '  and  e '"'r-die-’  ■'■'tance, 

but  display  devices  to  simultaneously  meet  this  requirement  are 
necessarily  very  complex  and  very  expensive  and,  beyond  some 
limitations,  are  not  yet  state  of  the  art.  More  simple  displays  are 
sometimes  used  which  may  be  adequate  for  particular  tasks  in 
training  simulators,  but  the  lack  of  any  real  experimental  evi¬ 
dence  on  the  appropriate  performance  levels  for  mission 
rehearsal  displays  makes  it  difficult  to  provide  guidelines  on  the 
type  of  display  which  should  be  chosen  for  future  mission 
rehearsal  systems. 

A  brief  description  of  some  of  the  display  types  used  in  training 
simulators  is  given  below;  mission  rehearsal  displays  will  be 
similar  and  it  is  likely  that  training  and  rehearsal  could  be  car¬ 
ried  out  on  the  same  facility. 

Directly-Viewed  Displays.  The  simplest  type  of  display  creates 
an  image  on  a  single  surface  which  is  viewed  directly  by  the 
pilot.  To  obtain  resolution  close  to  required  levels  combined 
with  a  reasonable  field-of-view  currently  implies  the  use  of  a 
Cathode  Ray  Tube,  although  other  display  types  such  as  liquid 
crystal  screens  are  starting  to  challenge  the  CRT.  The  sizes  and 
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standards  in  use  are  the  same  as  those  already  described  in 
4.1 .2.4  as  being  suitable  for  map  displays. 

The  main  advantages  of  a  simple  display  of  this  type  are  their 
cost  and  their  compatibility  with  existing  designs  of  commercial 
workstation.  The  main  deficiency  is  the  very  restricted  field-of- 
view  which  is  likely  to  make  it  unusable  for  some  types  of  mis¬ 
sion.  such  as  helicopter  operation  close  to  the  ground. 

Larger  CRTs  with  up  to  2000  x  2000  pixels  are  now  becoming 
available  although  they  are  not  yet  sufficiently  rugged  for  some 
military  applications,  but  any  directly-viewed  single-screen  dis¬ 
play  will  always  be  seriously  deficient  relative  to  the  likely  re¬ 
quirements  for  mission  rehearsal. 

In  some  training  simulators  the  CRT  is  viewed  .hrough  a  colli¬ 
mating  optical  system  which,  in  its  simplest  form,  can  be  a  sim¬ 
ple  pancake  lens.  Although  some  realism  is  added  by  image 
coUimalion.  there  remains  the  fundamental  disadvantage  of  nar¬ 
row  field-of-view. 

Multiple  Displays.  Several  alternative  arrangements  have  been 
adopted  in  training  simulators  to  provide  more  representative 
fields-of-view,  and  these  are  likely  to  be  considered  also  by 
designers  of  rehearsal  systems.  The  two  basic  options  available 
are: 

1)  Several  CRT  displays  mounted  side-by-side  and  either 
viewed  directly  or  through  optical  collimators. 

2)  One  or  more  projection  displays  which  illuminate  a 
screen,  often  in  the  form  of  a  dome,  on  which  the 
image  is  focused. 

The  use  of  more  than  one  display  can  be  convenient  in  the  over¬ 
all  system  design  since  each  display  can  be  interfaced  with  a 
separate  processor  allowing  the  image  generation  to  be  shared 
between  parallel  processors.  The  main  disadvantage  is  increased 
complexity  and  the  difficulty  in  obtaining  a  complete  visual 
scene  with  acceptable  continuity  between  the  separate  images. 
The  projection  systems  also  suffer  from  generating  brightness 
levels  much  below  real-life. 

Display  systems  of  these  types  are  used  in  almost  all  full  flight 
training  simulators,  and  a  dome  version  is  the  baseline  choice 
for  the  USAF  .Special  Operations  Forces  mission  rehearsal  sys¬ 
tem.  The  need  for  alternative  systems  which  are  better  matched 
to  the  headfeye  characteristics  has  led  to  the  development  of 
more  radical  solutions  which  arc  discussed  below. 

Head/Eye-Slaved  Displays.  For  many  military  aircraft,  and 
particularly  for  helicopters,  the  wide  canopy  allows  the  aircrew 
to  view  the  outside  world  over  a  very  wide  arc.  using  a  combi 
nation  of  head  and  eye  movement.  As  the  head  and  eyes  are 
moved,  the  instantaneous  field-of-view  occupies  only  a  small 
part  of  the  total  swept  field  of-view.  so  that  the  remaining  part 
cannot  be  seen.  It  follows  that  a  fixed  simulator  display  which 
covers  the  total  field-of-view  is  always  providing  an  image  of 
which  only  a  part  can  be  seen  at  any  instant.  By  moving  the 
position  of  the  displayed  image  in  space  so  that  it  is  always  cen¬ 
tered  upon  the  eyes'  centerlines,  this  waste  of  image  can  be 
averted  and  considerable  image  display  and  processing  can  be 
saved. 

Slaving  the  display  image  to  the  eyes  requires  knowledge  of  eye 
pointing  direction,  and  this  is  not  easily  measured.  A  simpler 
concept,  which  is  easier  to  implement,  is  to  measure  head  orien¬ 
tation  and  slave  the  display  position  to  it;  the  display  must  then 
have  a  field-of-view  equal  to  that  of  the  eyes  plus  the  maximum 
angular  movement  of  the  eyes  within  the  head.  A  number  of 


research  and  training  simulators  have  used  this  technique  (4.9, 
4.10)  and  there  are  several  suitable  head  position  sensors  com 
mercially  available.  The  display  is  usually  of  the  projection  type 
using  a  dome  screen.  An  alternative  and  much  simpler  arrange¬ 
ment  is  to  mount  the  display  on  the  pilot's  helmet  so  that  it 
automatically  follows  the  head  movement,  but  helmet-mounted 
displays  have  disadvantages  of  limited  field-of-view  and  resolu 
tion  as  well  as  being  rather  clumsy  to  wear. 

It  is  likely  that  research  into  the  techniques  of  measuring  eye 
position  will,  in  the  near  future,  generate  compact  and  accurate 
sensors  that  will  enable  the  eyes'  point  of  regard  to  be  accurately 
determined.  This  will  allow  the  so-called  point-of-regard  dis¬ 
plays  to  be  developed  as  practical  simulator  devices.  In  these 
displays  advantage  is  taken  of  the  eye  resolution  characteristics 
described  in  4.1.1  and  illustrated  in  Figure  4-2.  The  displayed 
image  is  configured  to  have  a  centra]  high-dcfinition  area  corre¬ 
sponding  to  the  central  high  resolution  area  of  the  eyes,  together 
with  a  lower  definition  area  for  the  remainder  of  the  field-of- 
view.  Significant  saving  in  image  processing  results,  but  the 
transport  delay  in  the  processors,  which  is  a  problem  with  hcl 
met-mounted  displays  [4.101,  has  to  be  reduced  to  prevent  per¬ 
ceptible  lags  with  rapid  eye  movements.  As  with  head-slaved 
displays,  point  of-regard  displays  w  ill  probably  mainly  of  the 
projection  type  with  the  complication  that  the  central  and  outer 
areas  must  be  blended  together  to  prevent  a  perceptible 
boundary 

The  main  advantage  of  point -of  regard  displays  is  that,  by  ptop- 
erly  matching  the  display  characteristics  to  those  of  the  head  and 
eyes,  they  are  able  to  provide  levels  of  resolution  which  should 
be  adequate  for  the  most  dem.uiding  tasks.  It  can  be  expected 
that,  as  the  techniques  and  equipment  for  measuring  and 
display-rotation  become  further  developed,  these  types  of  dis¬ 
play  will  be  increasingly  used  m  training  and  rehearsal 
simulators  (4.1 1 1. 

Airborne  Display.s.  In  the  di.scussion  on  airborne  m.ap  displays 
in  2..‘i  it  has  already  been  noted  that  the  small  sire  of  display 
space  in  military  cockpits  and  the  lunbient  light  conditions  seri- 
ou.sly  degrade  the  display  quality  to  the  extent  that  formats  must 
be  simplified.  The  siaiation  for  perspective  displays  is  similar, 
and  because  of  the  complexity  of  some  visual  scenes  may  be 
even  wor.se  It  i.s.  likely  therefore,  that  di.splay  limitations  will 
be  a  significant  factor  in  deteniiimng  tlie  effectiveness  of  future 
aiibome  mission  planning  anu  rehearsal  systems  incorporating 
pers[)cctive  displays.  It  is  possible  that  helmet  mounted  point 
of-regard  displays  may  have  useful  potential  for  airborne  appli 
cation,  but  much  research  on  both  the  technology  and  on  the 
human  fiictors  aspects  will  be  required  to  establish  their  real 
value 

4.1.4  Sensor  Displays. 

Most  modem  military  aircraft  arc  equipped  with  imaging  sen¬ 
sors  which  arc  used  to  aid  the  aircrew  in  such  tasks  as  ground 
clearance  and  navigation,  target  detection,  acquisition  and 
recognition.  For  these  purposes  the  sensor  image  is  displayed  to 
the  crew  on  displays,  usually  CRT's,  on  the  instrument  panel  or 
helmet-mounted.  In  providing  a  simulation  of  a  planned  mis¬ 
sion  for  rehearsal  purposes  it  is  necessary  to  simulate  the  sensor 
displays  with  appropriate  fidelity,  particularly  if  this  sensor  in¬ 
formation  is  critical  to  the  success  of  the  mission. 

The  display  and  the  associated  prtK'cssing  do  not  present  a  prob¬ 
lem  since  these  can  be  based  on  those  used  in  the  aircraft.  The 
other  clcmenLs  of  Figure  4-1,  the  database  and  image  generator. 


will  be  similar  to  those  used  in  a  visual  simulation,  but  may 
have  the  following  significant  differences: 

1)  The  resolution  may  be  either  greater  or  less  depending 
upon  the  effective  magnification  and  field-of-view  of 
the  sensor. 

2)  Reflection  characteristics  at  radar  wavelengths  of  both 
terrain  and  features,  and  emission  characteristics  in  the 
IR,  will  differ  from  those  in  the  visual  band  and  will 
need  to  be  included  in  the  database  model.  Speckle  and 
glint  are  particularly  difficult  to  model. 

3)  Atmospheric  and  ambient  lighting  effects  may  need  to 
be  included  which  are  often  quite  different  from  those 
used  in  the  visual  model. 

Training  simulators  have  been  built  in  which  these  differences 
have  been  successfully  allowed  for,  and  the  techniques  used 
should  be  equally  applicable  to  mission  rehearsal  simulators.  It 
should  be  noted,  however,  that  the  additional  contents  of  the  ter¬ 
rain  and  feature  database  models,  such  as  glint  information,  may 
require  more  preparation  time  unless  they  can  be  generated  by 
an  automated  process. 

One  problem  reported  in  [4,121  concerns  the  need  to  ensure  that 
the  visual  and  sensor  displays  are  properly  correlated  in  terms  of 
spatial  content  and  of  timing;  this  problem  is  particularly  diffi¬ 
cult  when  the  image  generators  and  databases  for  the  visual  and 
sensor  images  are  developed  by  different  organizations.  Ref 
[4,13]  discusses  the  database  requirements  for  the  simulation  of 
helmet-mounted  night  vision  goggles  which  have  spatial  and 
intensity  characteristics  which  require  unique  database  shadow 
and  contrast  features. 

4.1,5  Recommendations  for  Future  R&U. 

4l5  t  Map  Displays. 

Present  trends  are  increasingly  to  use  equipment  based  on  com¬ 
mercial  standards  for  the  display  of  map  information  in  ground- 
based  mission  plaruiing  systems;  this  has  significant  advantages 
in  terms  of  first  cost,  updating  aiid  modification  cost  and 
Interoperability.  It  is  unlikely  that  future  system  requiremenLs 
will  result  in  any  departure  from  that  trend.  Future  systems  will 
take  advantage  of  improvements  in  commercially-availablc 
techiwlogy  as  they  appear,  but  it  ap,  cars  unlikely  that  any  R&D 
aimed  specifically  at  the  military  map  di.splay  application  will 
be  required. 

For  airborne  map  aisplay,  where  present  displays  are  clearly  in 
adequate  for  mission  planning  purposes,  research  programs  in 
many  countries  over  several  years  arc  now  beginning  to  produce 
flat-panel  displays  which  are  of  sufficient  quality  to  match 
CRT s.  These  programs  will  cert„.nly  continue,  to  meet  the 
needs  of  both  the  airborne  display  market  as  well  as  a  range  of 
other  commercial  and  military  users,  and  it  is  likely  the  flat- 
panels  will  replace  CRT's  for  most  future  aircraft.  Airborne 
mission  planning  systems  will  be  able  to  take  advantage  of  fu¬ 
ture  performance  improvements,  but  no  specific  R&D  is  pei- 
ceived  to  be  justified. 

4  13.2  Mission  Rehearsal  Displays 

There  is  cunently  very  little  experience  of  the  usefulness  of  mis¬ 
sion  rehearsal  systems,  either  airborne  or  pre-flight,  and  al¬ 
though  the  discussion  in  Section  4. 1 .3  has  pointed  to  the  need 
for  improved  display  systems  there  is  no  experimental  or  practi¬ 
cal  evidence  to  substantiate  this  view.  In  recommending  future 


R&D  programs,  it  is  therefore  necessary  to  emphasize  that  the 
first  need  is  to  carry  out  properly  structured  experiments  to 
establish  relationships  between  the  effectiveness  of  mission 
plarming  systems  and  the  quality  of  the  displayed  visual  scene. 
Experience  of  the  development  of  training  simulators  shows  that 
such  experiments  will  be  difficult  to  conduct,  and  that  it  will  be 
many  years  before  definitive  information  is  available  on  suitable 
standards  for  display  parameters  such  as  resolution,  field-of- 
view  etc. 

In  the  absence  of  this  information  it  appears  reasonable  that  im 
provements  in  display  resolution  will  continue  to  be  sought. 
The  most  promising  way  to  aciiieve  this  appears  to  be  by  using 
eye  point-of-regard  displays  as  discussed  in  4. 1,3. 5.,  and  re¬ 
search  in  this  area,  which  includes  development  of  suitable  eye- 
position  sensors,  is  recommended.  Such  displays  must  be 
matched  by  image  generators  witJi  low  transport  delays,  but  it 
can  be  expected  that  future  image  generators  will  be  able  to  take 
advantage  of  the  continuing  improvements  in  computer  power 
which  will  become  available  in  the  future. 

Another  desirable  improvement,  particularly  in  perspective  dis¬ 
plays.  would  be  increased  display  brighuiess.  Curreni  CRT's  are 
approaching  fundamental  limits,  but  liquid  crystal  displays 
having  back  lighting  or  projection  capability  offer  considerable 
promise  in  this  respect,  and  development  of  versions  optimized 
for  simulation  applications  should  be  worthwhile.  Provision  of 
stereoscopic  information  could  be  useful  for  operation  close  to 
ground  features,  e  g,  for  helicopters,  but  more  research  is  re¬ 
quired  to  establish  whether  this  would  be  a  significant  im¬ 
provement.  If  it  is,  then  it  would  be  reasonably  easy  to  incorjxi- 
rate  into  eye  [Xiint-of  regard  displays. 

Two  aspects  of  database  design  merit  improvement.  For  mis¬ 
sion  rchciusal  sy.stems  the  time  taken  to  build  databases  will  al¬ 
ways  be  a  critical  factor,  and  automation  of  this  process  to  re¬ 
duce  ume  and  manpower  requires  more  R&D.  The  time  and  cost 
of  building  dalaba.se  models  is  .ilso  dependent  on  the  availability 
of  existing  data  in  a  form  suitable  for  rapid  and  automatic  re¬ 
formatting  a.s  required.  Initiatives  such  as  US  AF  Project  2851 
on  standard  formats  for  simulator  databases  should  therefore  be 
therefore  be  continued,  preferably  on  a  pan-NATO  basis.  The 
standardization  of  the  formats  used  for  other  data,  such  as  intel¬ 
ligence  inforiiiation.  also  deserves  study. 

4.2  AUVANCKD  INTERFACE  TKCHMQL  KS  FOR 
.Vtl.SSION  PLANMNi;. 

4.2.1  Introduction. 

The  (Kiwer  of  current  state  of  tlie-art  computationally  based  .sys- 
terns  is  staggering.  The  evolutionary  uend  in  the  development 
of  these  systems  indicates  more  power,  through  faster  devices 
and  more  parallel  processing,  will  be  available  in  the  future. 
These  systems  will  be  employed  in  future  mission  planning/ 
mission  rehearsal  systems,  Tlie  management  of  this  power  by 
the  user,  for  mission  planning  or  other  applications,  is  largely 
constrained  by  the  interface  between  the  user  and  the  system, 
where,  in  mission  planning  operations,  the  system  can  range 
from  small  field-operated  units  to  shipboard  mission  rehearsal/ 
planning  units,  and  the  user  can  range  from  a  fighter  pilot  to  a 
theater  battle  planner.  A  melding,  through  the  interface,  be¬ 
tween  user  and  sy.stem,  can  couple  the  inductive  capability  of 
the  system  with  the  enormous  deductive  power  of  the  human 
user.  Advanced  mulli-scn.sorial  interface  concepts  and  tech¬ 
nologies  can  aid  this  melding  process  by  providing  a  flexible 


and  adaptive  interface  medium.  This  Section  describes  some  of 
the  advanced  interface  concepts  and  technologies  which  may  be 
employed  in  future  mission  plaiming/rehearsal  systems  as  well 
as  begin  to  describe  application  of  these  concepts  and 
technologies. 

4JU  Virtual  Interface  Concepts. 

The  application  of  advanced,  multi-sensor  interface  concepts 
may  best  be  accomplished  using  a  combination  of  non-virtual 
(or  conventional)  and  virtual  control  and  display  devices.  The 
use  of  a  combination  of  virtual  and  non-virtual  devices  can  cre¬ 
ate  a  novel  experience  for  the  user,  an  experience  that,  for  mis¬ 
sion  planning  systems,  makes  the  mission  planning  task  more  of 
a  mission  rehearsal  or  mission  training  aid.  This  type  of  experi¬ 
ence,  in  the  general  sense,  has  been  termed  virtual  reality  in  the 
current  literature.  The  perceptual  space  created  by  this  experi¬ 
ence  has  been  termed  the  virtual  environment. 

The  virtual  environment  concept  takes  advantage  of  the  fact  that 
humans  experience  reality  through  'he  combination  of  their 
senses  and  internal  representations  of  the  environment  existing 
previous  to  the  current  sensory  stimulation.  The  representation 
of  a  cunent  en*ironr'ent  developed  by  a  human  is  formed  by 
the  continual  processing  of  energy  within  the  environment  trans¬ 
formed  by  the  human  through  the  sense  organs  and  transmitted 
within  the  human  by  the  central  nervous  system.  The  process¬ 
ing  of  this  energy  within  the  huma.n  is  complex  and  adaptive. 
Virtual  environments  can  create  artificial  realities  for  humans. 
In  essence,  to  the  human  in  the  virtual  environment,  one  reality 
exists  outside  the  virtual  environment  and  a  second  reality  exists 
within  the  virtual  environment. 

The  display  and  control  system  which  produces  the  multi-sen¬ 
sory  stimulation  for  the  user  is  genetically  called  the  virtual  en¬ 
vironment  generator.  A  generic  virtual  environment  generator 
can  best  be  described  by  drawing  an  analogy  with  a  computer 
graphics  system.  In  fact,  the  traditional  elements  comprising  a 
graphics  system  also  comprise  a  virtual  visual  environment  sys¬ 
tem.  There  is  an  image  generator,  an  image  transducer,  a  dis¬ 
play,  and  finally  an  input,  or  control,  mechanism.  The  differ 
ence  between  a  virtual  visual  envirotunent  generator  and  a  con¬ 
ventional  visual  environment  generator  is  in  the  display  itself;  in 
the  virtual  visual  case,  the  display  is  a  virtual  display.  Examples 
of  virtual  displays  are  helmet  mounted  displays  and  head-up 
displays.  Environment  generators  for  the  other  human  senses 
are  comprised  of  similar  functional  blocks,  with  the  display, 
transducer,  and  control  taking  a  different  form.  Typically,  the 
image  generator,  whatever  the  scn.se  modality,  creates  the  initial 
image  electronically,  the  transduce'  transforms  the  electronic 
image  into  a  format  useful  for  the  display,  which  creates  energy 
which  can  be  sen.scd  directly  by  the  human,  such  as  light,  sound, 
etc. 

The  quality  of  the  artificial  reality  experience  created  by  the  vir 
tual  environment  generator  is  dependent  on  the  fidelity  of  the 
sensory  stimulation.  If  the  intent  is  to  emulate  a  naturally  occur¬ 
ring  environment,  the  virtual  environment  must  accurately 
recreate  the  sensory  stimulus  of  the  naturally  occurring  envi¬ 
ronment  and  accurately  present  it  to  'he  human  observer,  and 
allow  the  human  to  naturally  interact  wit.i.  and  affect,  the  out 
side  environment 

4.2J  Enabling  Technologies. 

Several  technologies  are  currently  being  utili/cd  to  create  virtual 
environments.  Some  of  these  technologies  arc  very  mature. 


others  are  in  their  infancy.  One  of  the  most  mature  technologies 
is  computer  graphics.  This  is  fortunate  in  that  some  estimates  of 
information  processing  by  humans  list  vision  as  typically  being 
used  for  80%  of  information  input.  This  fact  makes  computer 
graphics  the  single  most  important  technolrgy  for  the  creation 
of  robust  virtual  environments. 

Other  technologies  are  also  involved  in  the  formation  of  visual 
environments.  Some  of  these  technologies  are  being  considered 
for  incorporation,  or  are  already  integrated,  into  aircraft  cock¬ 
pits.  These  include  helmet  mounted  displays,  hi  Imet  mounted 
head.  hand,  and  eye  line-of-sight  trackers,  and  three  dimensional 
auditory  displays. 

These  devices  have  been,  and  continue  to  be,  developed  and 
evaluated  by  several  academic,  industrial,  and  military  institu¬ 
tions.  Other  devices  which  enable  the  portrayal  of  virtual  in¬ 
formation  are  less  further  developed.  These  include  tactile/ 
haptic  stimulation  devices,  hand  and  body  flexure  measurement 
devices,  direct  vestibular  stimulators,  direct  retinal  displays,  and 
directly-coupled  brain-actuated  control. 

4.2.4  Research  Considerations. 

The  integration  of  virtual  display  and  control  techniques  with 
conventional  display  and  control  techniques  for  missior,  plan¬ 
ning  systems  should  be  guided  by  characteristics  of  the  human 
interacting  with  the  virtual  environment.  The  human  is  a  com¬ 
plex  and  adaptive  receiver  whose  perceptual  performance  is  tied 
to  the  quality  of  the  visual  and  auditory  stimulus  generated  and 
controlled  by  tlie  display  generators.  Perceptual  research  which 
may  impact  the  design,  development  and  application  of  virtual 
environment  technology  in  the  areas  of  vision,  audition,  and 
propritKcplion  is  being  pursued  internationally.  However,  many 
questions  remain  unanswered  regarding  virtual  techniques, 
which,  when  answered,  may  increa.se  the  potential  usefulness  of 
virtual  interface.  In  addition,  each  new  application  of  virtual 
devices  brings  new  research  questions  to  light.  Some  of  the  re¬ 
search  questions  arc  discussed  tvlow , 

4  2-41  Muilt-Sensory  I ruf^ruiion  Issues. 

An  area  of  research  demanding  significant  attention  at  this  time 
IS  the  .sensory  integration  a.sisects  of  displaying  virtual  informa¬ 
tion.  While  technology  components  for  virtual  displays  have 
been  developed,  a  complete  understanding  of  the  integration 
techniques  required  to  blend  these  conqv'nenLs  into  robust  arti¬ 
ficial  realities  docs  not  exist.  Tlie  need  for  an  understanding  of 
human  sensory  integration  characteristics  and  display  integra¬ 
tion  techniques  is  partially  a  result  of  the  traditional  boundaries 
established  between  researchers  In  addition,  a  researcher  in  the 
area  of  sensory  integration  must  {xisses  a  deep  understanding  of 
the  characteristics  of  each  sensory  channel  when  operated  inde 
pendenlly.  Tins  is  imleed  a  ch.illenge 

The  |iers|>cctive  to  be  taken  in  this  research  is  one  of  viewing  the 
visual  auditory  motion  {lerccplua!  interaction  as  a  pnxiucl  of  an 
integrated  sensory/pcrceptual  process.  Humans  are  continually 
priKcssing  stimuli  from  multiple  seasory  sources  and  integrating 
these  stimuli  into  coherent  [x-rceptions  of  their  environment. 
The  integrated  jx;rsix’ctive  taken  in  this  research  enables  the  in¬ 
teractions  and  influences  of  the  auditory  and  visual  modalities  to 
be  illuminated  and  investigatcil 

Stroboscopic  stimuli  are  significant  within  virtual  interfaces. 
All  visual  graphics  utili/e  stroboscopic  stimuli  as  they  redraw 
the  visual  scene  in  a  raster  format  in  discrete  time  periods  and, 
thus,  rely  on  apparent  motion  perception  of  the  viewer  to  fuse 
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the  discrete  images.  Auditory  virtual  displays  may  be  continu¬ 
ously  excited  or  they  may  update  the  auditory  presentation  in 
discrete  time  periods  in  a  similar  fashion  to  visual  displays.  It  is 
important  that  latency  differences  between  the  different  sensory 
channels  are  not  apparent  to  the  human  operator. 

4.24.2  Augmentation  vs  Full  Immersion. 

When  the  use  of  virtual  envirorunents  is  considered  for  mission 
planning  systems,  the  question  of  how  much  virtual  reality  is 
enough  must  be  considered.  Within  the  current  virtual  reality 
literature,  this  question  is  discussed  using  the  terms  full  immer¬ 
sion  virtual  reality  and  virtually -augmented  reality.  A  very  good 


example  in  the  aerospace  field  of  virtually-augmented  reality  is 
the  super-position  of  HUD  symbology  on  oui-of-the-cockpit 
features  in  aircraft.  This,  of  course,  has  been  done  for  many 
years  and  thus  the  term,  virtually-augmented  reality  is  a  new 
term  for  an  existing  technique.  Full  immersion  virtual  reality  is 
also  not  new,  an  example  being  flight  simulation.  The  robust¬ 
ness  of  the  reality  created  is  at  the  heart  of  the  question.  While 
the  pilot  operating  in  a  flight  simulator  is  full-immersed,  some 
of  the  cues  found  in  the  "real"  situation  carmot  be  fully  dupli¬ 
cated  in  the  simulator,  such  as  acceleration  cues.  The  extent  of 
virtual  environment  use  for  mission  planning  requires  to  be  ex¬ 
plored  in  much  greater  depth  than  has  so  far  been  attempted. 
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Chapter  5 

Computational  Techniques 


5.1  INTRODUCTION. 

A  major  concern  involving  all  aspects  of  mission  planning  sys¬ 
tems  is  the  tremendous  computational  burden  that  is  required  for 
a  wide  variety  of  mission  planning  functions.  In  this  Chapter  we 
address  computational  techniques  for  automating  the  generation 
of  the  mission  plan.  Presently,  mission  planning  system  soft¬ 
ware  is  used  to  support  the  mission  plaiuier  in  generating  a  plan, 
and  to  possibly  assist  in  the  evaluation  of  that  plan.  In  the 
future,  it  is  expected  that  mittsion  planning  systems  will  expand 
these  functions  to  include  automatic  plan  generation.  In  this 
mode  of  operation,  the  planner  can  enter  mission  constraints  and 
objectives  into  the  system  and  ask  the  mission  planning  system 
to  generate  the  best  plan  it  can,  while  meeting  the  objectives  and 
constraints.  The  user  can  accept,  reject  or  modify  the  resulting 
plan.  However,  in  order  to  realize  this  capability,  advances  in 
computational  techniques  are  required  to  deal  with  the  severe 
complexity  of  mission  planning  problems. 

Mission  and  trajectory  planning  problems  are  complex  and  diffi¬ 
cult  for  a  variety  of  rea.sons.  First,  multiple  (and  often  conflict¬ 
ing)  objectives  must  be  pursued  in  the  face  of  a  variety  of  both 
implicit  and  explicit  constraints.  Representative  mission  objec¬ 
tives  include  reconnaissance,  resupply,  support  and  strike. 
Implicit  constraints  are  constraints  that  are  imposed  by  the 
vehicle  design  (e  g.,  its  fuel  carrying  capacity,  stores  carrying 
capacity,  performance  envelope  and  subsystem  capahilitic.s). 
Explicit  constraints  are  constraints  that  may  be  imposed  by  a 
higher  planning  authority  (e  g.,  a  required  probability  of  survival 
or  mission  success,  time  or  ordering  constraints  that  m.ay  be 
imposed  on  the  pursuit  of  specific  mission  objectives,  naviga¬ 
tion  constraints,  maneuvering  constraints  within  the  vehicle's 
performance  envelope  and  constraints  imposed  by  the  lime 
available  to  plan). 

5.2  APPROACHKS. 

Computational  techniques  for  solving  mission  pKinning  opti- 
mi/ation  problems  can  gerierilly  be  grouped  into  two 
categories: 

•  Optimal  Approaches 

•  Heuristic  Apjiroaches 

Optimal  approaches  have  an  advantage  over  heuristic  ap 
proaches  in  that  they  are  guaranteed  to  generate  optimal  solu 
tions;  however  tliis  performance  advantage  comes  at  the  cost  of 
much  greater  computational  requirements  for  all  but  the  lca.si 
challenging  problems.  There  arc  five  classes  of  methods  for 
generating  optimal  solutions  to  mission  planning  problems; 

•  Complete  Enumeration.  The  simplest  method  of  obtain¬ 
ing  an  optimal  solution  to  mission  planning  problems  is 
to  evaluate  every  possible  mission  plan,  keeping  track  of 
the  best  solution.  This  approach  is.  of  course,  com¬ 
pletely  impractical  for  all  but  the  smallest  problems  as 
the  solution  time  grows  exponentially  with  problem  size. 

•  Dynamic  Programmin/i  This  approach  generates  opti¬ 
mal  solutions  faster  than  exhaustive  enumeration. 
However,  the  solution  limes  required  by  dynamic  pro¬ 


gramming  [5.1, 5.2]  still  grows  exponentially  (albeit  less 
quickly  than  complete  enumeration)  with  problem  sizx;. 

•  Integer  Programming.  As  with  dynamic  programming, 
integer  programming  [5.3)  approaches  generate  optimal 
solutions  faster  than  using  complete  enumeration,  but 
the  time  to  solution  still  grows  exponentially  with  prob¬ 
lem  si/e. 

•  Gradient  Methods.  Gradient  methods  [5.4]  are  useful 
for  solving  optimization  problems  that  have  well 
behaved  utility  functions.  Gradient  approaches  have 
particular  difficulty  for  utility  functions  that  contain 
large  numbers  of  local  maxima  (which  is  the  case  for  the 
.Mission  Planning  Problem)  as  they  tend  to  converge  on 
and  become  trapped  in  the  local  maxima. 

•  Nekton  Methods.  Newton  methods  [5.4]  use  second 
derivatives  (or  the  Hessian  matrix  for  multi-variable 
functions)  to  improve  upon  gradient  methods.  These 
approaches  are  useful  for  certain  types  of  optimization 
problems  that  have  well  defined  utility  functions,  but  are 
otherwise  difficult  or  in  some  cases  impossible  to  use.  as 
is  the  case  for  die  Mission  Planning  Problem. 

The  major  hope  for  applying  optimal  mclluxis  to  mission  plan¬ 
ning  (iroblems  is  the  development  of  parallel  processing  archi¬ 
tectures.  Parallel  processing  archileclures  are  reviewed  in 
.Section  5.2. 

In  addition  lo  optimal  lechniiiues,  there  are  a  variety  of  sub- 
optinial.  heuristic  approaches,  available  for  solving  huge  scale 
optimization  problems  .  llie  following  metluxis  were  identified 
as  methods  that  might  be  ap)ilied  to  mission  pl.mning  systems. 

•  Machine  Learning 

•  Expert  Systems 

'  Neural  Networks 

•  Siimilaieil  Annealing 

In  Section  5,.'  we  review  these  heuristic  methods  and  discuss 
their  |Hissible  applications  to  mission  planning  problems. 

5..I  I’AKAI.l.F.L  PRfX'F.SSINt;. 

To  make  the  use  of  o[Uimal  methods  in  solving  all  but  the  most 
rudimentary  mission  pl.mning  jiroblems.  it  becomes  necessary  to 
liHik  to  parallel  processing  arcliileeliires. 

SJ.l  Hardware. 

Tlic  spectrum  of  aiiproaches  to  parallel  processing  can  be  classi¬ 
fied  in  terms  of  a  few  fundamental  characteristics:  granularity, 
i.c.  the  size  and  capability  of  the  individual  processors;  The 
prixessor  architecture,  (i.e.  the  way  in  which  the  proce.ssors  and 
memory  elements  arc  interconnected);  and  control,  (i.e  whether 
system  behavior  is  directed  centrally  or  in  a  distributed  manner). 
A  parallel  processing  soluiion  lo  a  given  problem  should  incor¬ 
porate  the  combination  of  these  characteristics  that  best  address 
the  computational  aspects  ol  the  problem.  The  Strategic 
Computing  Initiative  (SCI)  is  currently  funding  a  variety  of 
hardware  realizations  of  parallel  processing  concepts  that  repre- 
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sent  promising  candidates  for  the  spectrum  of  intelligent  system 
applications  that  DARPA  envisions. 

The  specific  parallel  processor  systems  supported  by  the  SCI 
include  the  Systolic  Array,  the  Butterfly  Machine,  NON-VON, 
DADO,  Dataflow  Machines  and  the  Connection  Machine  [S.SJ. 
Others  may  emerge  as  a  result  of  current  architecture  competi¬ 
tions  [5.6).  In  addition,  other  parallel  processing  architectures 
have  been  developed  outside  the  scope  of  the  SCI,  such  as  the 
Delencor  HEP. 

Although  much  work  has  been  done  in  the  hardware  develop¬ 
ment  of  parallel  processors,  the  applications  of  these  processors 
is  still  in  its  infancy.  Applications  such  as  solving  linear  equa¬ 
tions  or  singular  value  decompositions  on  systolic  arrays  have 
been  successful,  but  a  significant  application  of  these  machines 
in  real-time  decision-making  environments  has  not  been  accom¬ 
plished.  In  particular,  solving  unstructured  problems  like  the 
planning  problem  described  in  Chapter  2  has  not  been 
attempted.  With  the  present  maturity  of  planning  algorithms 
and  related  areas  of  artificial  intelligence,  the  time  appears  ripe 
to  exploit  these  architectures. 

Parallel  machine  architectures  may  be  broken  down  according  to 
a  number  of  different  criteria.  An  important  major  classification 
is  computational  granularity,  the  processing  power  of  the  indi¬ 
vidual  computing  elements  contained  within  the  architecture. 
As  a  practical  and  economic  matter,  the  smaller  the  granularity, 
the  larger  the  number  of  computational  elements  that  may  be 
interconnected.  Therefore  the  most  massively  parallel  machines 
are  always  constructed  from  the  simplest  of  computational  ele¬ 
ments,  One  example  of  a  very  fine-grained  parallel  processor  is 
TMI's  Connection  Machine,  where  as  many  as  65,536  individual 
elements  can  be  interconnected  to  form  a  single  parallel  comput¬ 
ing  architecture.  On  the  other  end  of  the  scale,  a  parallel  proces¬ 
sor  may  be  built  with  very  sophisticated  computing  elements, 
such  as  any  of  the  advanced  general  purpose  CPU's  currently 
available.  An  example  is  the  Enaire  Multimax  multi  prcK-essor, 
which  allow.?  up  to  20  National  .Semiconductor  32032  CPU's  to 
be  interconnected. 

SJ.2  Applications  to  Mission  Planning. 

The  field  of  mission  phmning  provides  numerous  areas  where 
speeding  up  computational  performance  would  be  beneficial. 
These  areas  include: 

•  Route  Planning 

•  Rad.ar  terrain  masking  computations. 

•  Processing  imagery. 

•  Providing  3D  out  llie  cockpit  displays 

•  Data  Fusion 

•  Database  Management 

It  remains  to  be  seen  if  the  emerging  parallel  processing  archi¬ 
tectures  can  be  successfully  exploited  by  u.scrs.  A  major  diffi¬ 
culty  is  developing  application  software  that  can  effectively  uti¬ 
lize  the  full  potential  of  parallel  architectures.  To  date,  the  most 
effective  use  of  parallel  processing  has  been  in  the  image  pro¬ 
cessing  community.  It  is  thcrforc  expected  that  advances  in 
parallel  processing  architures  will  benefit  mission  planning  sys¬ 
tem  user  interface  technology  and  mission  rehearsal  technology. 
In  other  areas,  such  a.s  route  optimaztion,  advances  need  to  be 
made  in  software  that  is  developed  specifically  to  exploit  paral¬ 


lel  processing  architectures.  .Some  work  is  taking  place  in  the 
academic  community  (5.7,  5.8[,  but  much  more  work  is  needed 
to  transition  this  research  into  the  field. 

The  use  of  parallel  processing  architectures  may  prove  to  be 
most  useful  in  supporting  the  mission  planning  process  in-flight, 
where  speed  is  much  more  critical  then  during  the  pre-mission 
plaiming  phase.  The  development  of  flight-computers  employ¬ 
ing  parallel  processing  architectures  will  be  very  important  to 
the  process  of  transitioning  automated  mission  planning  from 
pre-mission  to  in-flight. 

5.4  HEURISTIC  METHODS. 

The  use  of  heuristics  to  solve  otherwise  intractable  combinato¬ 
rial  optimization  problems  has  become  widespread  in  both  the 
engineering  and  operations  research  communities.  Heuristics 
are  strategies,  ideas,  rules,  guidelines,  procedures,  recipes,  or 
methods  used  to  guide  a  search  toward  the  optimal  solution 
within  the  solution  space.  Heuristics  exploit  knowledge  about 
the  specific  problem  domain  to  intelligently  guide  the  search,  so 
that  near -optimal  solutions  can  be  generated  in  a  fraction  of  the 
time  that  would  be  requited  to  generate  optimal  solutions. 
Below  we  review  some  of  ihe  heuristic  methods  that  may  be 
applicable  lo  mission  planning  problems. 

5.4.1  Machine  Learning. 

Recently  there  have  been  significant  advances  in  the  area  of 
machine  learning  algorithms  that  offer  some  promise  to  the  area 
of  mission  planning.  One  such  learning  technique  that  has  been 
applied  to  mission  planning  problems  is  associative  reinforce¬ 
ment  learning,  which  occurs  when  reinforcement  is  used  to  form 
associations  between  stimuli  and  resjxmses.  Although  associa¬ 
tive  reinforcement  learning  has  been  a  subject  of  research  for 
many  years,  the  difficulty  of  assigning  credit  for  reinforcement 
to  specific  responses  in  complex  learning  situations  has 
restricted  its  domain  of  application  lo  simple  learning  problems 
of  little  practical  imixirtance  How  ever,  recent  theoretical  and 
exjvrinienlal  studies  based  on  Klopf  s  model  of  associative  rein¬ 
forcement  learning  [5  d.  5.1('l  which  deal  with  goal-seeking 
adaptive  networks  composed  of  goal-seeking  adaptive  compo¬ 
nents  [5.1 1 1  suggest  that  it  ma>  lx:  possible  lo  extend  associative 
reinforcciiient  learning  lo  more  difficult  learning  problems 
whose  solutions  would  have  practical  significance.  The  refer¬ 
ences  cited  above  discuss  these  results  and  provide  extensive 
references  lo  other  releviml  research. 

There  is  an  iiii|xirlanl  distinction  to  be  made  between  reinforce¬ 
ment  learning  and  error  correcting  learning.  In  the  case  of 
error  csirreciiiig  learning,  the  system  need  only  remember  what 
it  is  told  (or  be  capable  of  generalizing  therefrom).  In  the  case 
of  reinforcement  learning,  on  the  other  hand,  the  system  must 
discover  what  responses  have  consequences  that  lead  to 
improved  performance.  A  statistical  adaptive  procedure, 
wherein  the  chance  occurrence  of  appropriate  or  inappropriate 
behavior  is  rewarded  or  punished,  plays  an  important  role  in  this 
process  of  di.scovcry.  Information  from  the  environment  is  used 
to  reward  or  punish  the  system's  behavior,  but  docs  not  instruct 
the  system  as  to  what  the  correct  behavior  would  have  been. 
This  statistical  adaptive  procedure  enables  the  reinforcement 
learning  system  lo  construct  a  model  of  the  system  and  the  envi¬ 
ronment  without  having  to  explicitly  solve  the  difficult  credit- 
assignment  problem  alluded  to  in  the  previous  paragraph.  As 
the  model  becomes  more  refined,  the  behavior  of  Ihe  vehicle 
becomes  more  directed  and  the  statistical  aspect  of  the  adaptive 
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process  becomes  less  imporumt.  Reinforcement  teaming  sys¬ 
tems  are  thus  able  to  improve  their  performance  in  environments 
that  provide  information  that  is  of  lower  quality  than  would  be 
required  by  error-correcting  teaming  systems. 

S.4.2  Expert  Systems. 

An  expert  system  is  a  collection  of  rules,  along  with  a  procedure 
for  using  the  rules  to  generate  satisficing  solutions  to  a  wide 
spectrum  of  problems.  The  rules  are  generated  by  human 
experts  in  the  problem  domain;  therefore  expert  systems  are 
somewhat  similar  to  heuristic  methods.  The  primary  difference 
between  the  two  is  one  of  implementation.  Heuristic  search 
techniques  tend  to  be  algorithmic,  while  expert  systems  are 
implemented  using  inference  engines  (e.g.,  forward  or  backward 
chaining)  that  operate  on  a  rule  base.  Expert  systems  find  solu¬ 
tions  that  are  consistent  with  the  rules,  but  do  not  necessarily 
search  for  optimum  solutions. 

Recent  applications  of  expert  systems  technology  to  a  large 
class  of  engineering  problems  (5.12  -5.20J  suggest  that  expert 
systems  may  be  useful  for  solving  complex  aerospace  planning 
and  control  problems.  Indeed,  major  efforts  are  underway  to 
develop  expert  systems  for  a  wide  variety  of  aerospace  applica¬ 
tions  including  DARPA's  Pilot's  Associate  program  [5.21], 
NASA's  space  station  energy  management  system  [5.22],  and 
NASA's  Systems  Autonomy  Development  Program  [5.23]. 

Some  of  the  aerospace  applications  for  which  expert  systems  are 
currently  being  considered  are  closely  associated  with  real-time 
life-critical  operations.  'Thus,  it  is  reasonable  to  expect  that 
eventually  such  expert  systems  will  play  real-time,  life-critical 
roles  in  these  applications.  As  with  other  systems  that  perform 
life  critical  tasks,  these  expert  systems  will  have  to  be  thor¬ 
oughly  evaluated  before  they  can  be  flight  tested.  This  evalua¬ 
tion  process  is  necessary  to  ensure  that  reliability  and  perfor¬ 
mance  requirements  are  satisfied.  However,  a  satisfactory  and 
generally  accepted  methodology  for  evaluating  the  reliability 
and  performance  of  expert  systems  does  not  currently  exist. 

Historically,  because  expert  systems  have  not  addressed  life 
critical  and/or  real-time  problems,  there  has  not  been  a  com¬ 
pelling  need  to  address  the  evaluation  problem.  To  date,  most 
investigations  of  the  evaluation  problem  have  been  cither 
incomplete  [5.24],  strictly  qualitative  [5.25],  [5.26],  or  problem 
specific  (5.27  -  5.30].  Recently.  NASA  convened  a  workshop  to 
address  issues  associated  with  verification  and  validation  of 
knowledge  based  systems  [5.31].  The  lack  of  a  general,  com¬ 
plete  and  quantitative  evaluation  methodology  is  a  major  imped¬ 
iment  to  exploiting  the  potential  of  expert  systems  in  aircraft  and 
spacecraft  systems. 

5.4  J  Neural  Networks. 

The  application  of  neural  networks  to  the  solution  of  optimiza¬ 
tion  problems  [5.32]  appears  to  have  a  variety  of  interesting 
applications,  among  which  is  the  solution  of  combinatorial 
optimization  problems.  In  spite  of  its  novel  perspective,  how¬ 
ever,  the  Hopfield  approach  to  the  solution  of  these  problems  is 
limited  by  its  inability  to  find  global  minima  with  a  single  invo¬ 
cation  of  the  algorithm.  It  is  effectively  a  steepest  descent  pro¬ 
cedure  that  settles  at  the  nearest  local  minimum.  Global  minima 
are  achieved  only  by  initializing  the  algorithm  at  a  sufficient 
number  of  different  starting  points.  The  primary  difficulties  of 
using  neural  networks  to  solve  optimization  problems  are: 
adapting  the  networks  to  solve  constrained  optimization  prob¬ 


lems;  and  mapping  complex  optimization  problems  into  neural 
network  representations. 

The  Boltzmami  Machine  [5.33],  and  the  Stochastic  Neural 
Network  Machine  [5.34]  combine  the  parallel  architecture  of  the 
Hopfield  network  with  the  optimal  seeking  property  of 
Simulated  Annealing  (see  5.3.4).  The  Boltzmann  Machine  min¬ 
imizes  the  same  energy  function  that  the  Hopfield  network  does, 
but  it  does  so  in  the  stochastic  manner  of  Simulated  Annealing 

[5.35] .  Increases  in  the  energy  of  the  network  occur  with  a 
probability  that  is  a  function  of  a  temperature  schedule.  In  this 
manner,  the  Boltzmann  Machine  escapes  local  minima  that  may 
be  encountered  during  the  search  for  the  global  minimum.  The 
Stochastic  Neural  Network  Machine  also  minimizes  the  energy 
function  of  the  Hopfield  network  in  accordance  with  a  similar 
system  of  differential  equations.  A  white  noise  term  is  added  to 
the  dynamics  of  each  neuron  in  the  system  to  keep  the  solution 
from  settling  into  local  minima.  'The  noise  term  is,  once  again,  a 
function  of  a  temperature  schedule.  Early  in  the  solution  proce¬ 
dure.  the  temperature  is  set  high  to  allow  escape  from  local  min¬ 
ima,  while  later  on,  the  temperature  is  reduced  to  allow  conver¬ 
gence  to  the  global  minimum. 

5.4.4  Simulated  Annealing. 

Simulated  annealing,  which  was  invented  by  Kirkpatrick  et  al. 

[5.36]  is  a  probabilistic  algorithm  for  solving  large  scale  opti¬ 
mization  problems  with  arbitrary  cost  functions.  It  is  based  on 
an  analogy  with  the  physical  amiealing  process  for  glasses  or 
metals,  where  low  energy  states  in  substances  such  as  metal 
alloys  are  attained  by  first  heating  the  substance,  then  cooling  it 
slowly.  This  process  allows  the  system  to  relax  into  a  low 
energy  configuration,  without  quenching,  i.e.,  without  getting 
trapped  in  higher  energy  states.  Simulated  annealing  uses  this 
approach  to  find  the  solution  of  large  scale  optimization 
problems. 

By  analogy  with  the  physical  annealing  process,  a  parameter 
called  the  "temperature"  is  intn>duccd  in  the  optimization  proce¬ 
dure.  This  temperature,  which  at  the  start  is  high,  is  decreased 
gradually.  At  a  fixed  tempcraiute,  a  procedure  such  as  the  one 
developed  by  Metropolis  ct  al.  [5.37]  is  applied  to  generate  a 
Gibbs  probability  distribution  over  the  solutions  of  the  opti¬ 
mization  problem.  This  Gibbs  distribution  gives  higher  proba¬ 
bilities  to  solutions  with  low  cost  function  values,  where  the 
value  of  the  cost  function  is  analogous  to  the  energy  in  a  physi¬ 
cal  annealing  process.  The  Metropolis  algorithm  or  any  equiva¬ 
lent  method  such  as  the  heat  bath  technique  [5.34,  5.38]  corre¬ 
sponds  to  a  stochastic  relaxation  procedure,  whereby  starting 
from  a  given  initial  solution,  a  statistical  equilibrium  is  gradually 
reached.  This  equilibrium  is  characterized  by  the  Gibbs 
distribution  corresponding  to  the  temperature  of  operation. 

Conceptually,  simulated  annealing  requires  the  gradual  lowering 
of  the  temperature  in  such  a  way  that  the  artificial  system  asso¬ 
ciated  with  the  optimization  procedure  remains  close  to  statisti¬ 
cal  equilibrium.  As  the  temperature  tends  to  zero,  the  probabili¬ 
ties  of  the  various  solutions  increase  for  those  with  lowest  cost 
function  values.  However,  the  requirement  that  the  system 
should  always  be  close  to  statistical  equilibrium  implies  that  the 
cooling  of  the  temperature  be  very  gradual  in  critical  tempera¬ 
ture  zones. 

'Theoretical  results  [5.39  -  5.41  j  on  the  convergence  of  the  simu¬ 
lated  annealing  procedure  to  the  optimal  solution  require  loga¬ 
rithmic  cooling  schedules,  which  makes  the  procedure 
extremely  slow.  In  practice,  faster  cooling  schedules  are 


37 


employed.  However,  these  faster  schedules  result  in  a  quench¬ 
ing  phenomenon  where  the  system  gets  trapped  in  a  local  mini¬ 
mum.  If  premature  quenching  occurs,  the  simulated  annealing 
procedure  will  fail  to  reach  the  globally  optimal  solution,  and 
may  yield  an  unsatisfactory  one. 

5,5  CONCLUSIONS. 

The  computational  techniques  discussed  in  this  Section  repre¬ 
sent  the  initial  steps  in  the  development  of  more  sophisticated 


automated  mission  planning  computational  methods.  It  is 
expected  that  in  the  future,  the  development  of  these  types  of 
computational  techniques  will  take  on  increased  importance,  as 
he  response  time  for  mission  planning  is  reduced.  The  success 
of  these  computational  techniques  will  depend  on  how  fast  they 
can  be  made  to  run,  while  maintaining  satisfactory  levels  of  per¬ 
formance.  To  accomplish  this  goal,  it  is  expected  that  parallel 
processing  architectures  will  become  necessary  to  meet 
throughput  requirements  of  the  computational  methods. 


38 


Chapter  6 

Information  Management 


The  mission  planning  process  is  dependent  on  the  availability  of 
up  to  date  data  that  is  derived  from  different  sources.  The  man¬ 
agement  of  such  information  is  vital  if  the  planned  mission  is  to 
bv  sur-cessfi:!.  The  are  rf  information  maragemem  is  therefore 
an  area  of  concern. 


6.1  DATA  FUSION. 

Fusion  of  data  for  mission  plarming  systems  is  required  to 
reduce  the  total  amount  of  information,  combining  different 
information  from  various  sources  and  eliminating  inaccurate 
data.  Mission  planning  requires  the  fusing  of  geographical 
information  and  data  on  enemy  assets. 

6.1.1  Fusion  of  Geographical  Information. 

Mission  planning  systems  and  navigation  call  for  a  growing 
volume  of  geographical  information;  altimetry,  planimetry 
(Roads,  Towns,  Railways...),  images,  three  dimensional  models 
of  targets,  toponimy,  radar  images,  etc. 

Usually,  this  information  is  produced  by  a  centralized  geograph¬ 
ical  survey.  This  service  uses  specific  techniques  to  collect  and 
refresh  all  the  information.  In  this  case,  the  time  needed  for 
producing  the  geographical  information  is  very  long  and  the  op¬ 
eration  is  sometimes  difficult  when  it  is  not  po-  hie  U)  go  into 
the  field  to  manage  survey  missions. 

Then  it  is  useful  to  have  a  mission  plarming  system  merging 
new  information  just  before  planning  or  during  the  flight. 

6.1  l.l  Sources. 

For  this  aim  the  .sources  of  geographical  data  are  mainly  from 
airborne  or  satellite  sensors. 

Airborne  Sensors.  There  are  various  airborne  sensors; 
Airborne  Radar.  Side  Looking  Radar.  Optical  or  Electro-optical 
equipment,  visually  marked  points. 

The  dau  collection  through  these  sensors  have  different  unpacts 
on  the  pilot's  workload.  The  information,  if  not  displayed  in  the 
cockpit,  IS  either  recorded  or  rent  to  a  ground  station  by  data 
link.  In  order  to  collect  this  information,  the  pilot  must  point  the 
sensor  in  the  direction  of  the  target  or  fly  a  predetermined  track, 
but  doesn't  need  to  interpret  the  images  during  the  flight.  This  is 
less  demanding  than  information  displayed  in  the  cockpit  which 
requires  the  pilot's  interpretation  to  carry  out  the  mission.  This 
information  is  issued  from  a  ground  mapping  radar,  a  Forward 
Looking  Infrared,  a  Laser  designator  pod,  or  visualization  of 
surroundings  through  Head  up  Display. 

Satellite  Sensors.  Two  types  of  satellites  cover  most  of  the  op¬ 
tical  spectrum.  One  is  civilian;  (e.g.  SPOT  and  LANDSAT),  the 
other  is  military  (e.g.,  KH  8,  9,  11,  for  the  US,  Helios  for 
France).  But  these  satellites  have  limitations  due  to  the  weather, 
the  clouds,  and  light  in  the  area  of  interest.  For  these  reasons 
the  use  of  radar  sensors  appears  to  be  complementary  and  oper¬ 
ationally  more  interesting. 


Images  of  on-board  Synthetic  .Aperture  Radars  are  being  exper¬ 
imented  with  to  generate  digital  Terrain  Models  or  to  localize 
targets  with  encouraging  results.  With  this  kind  of  sensor  the 
delay  for  obtaining  usable  daf*  is  shorter. 

Other  Sen.sors.  Geographical  data  can  be  also  extracted  from 
other  sources,  such  as  paper  maps,  intelligence,  ground  survey¬ 
ing  or  Geodesic  GPS  outputs. 

6. 1.1.2  Fusion. 

Geographic  data  fusion  is  different  when  executed  during  the 
flight  or  on  the  ground  during  mission  planning. 

In-Flight.  During  the  flight,  geographical  data  are  available 
from  the  airborne  database,  can  be  collected  with  airborne  sen¬ 
sors,  or  can  be  received  tlirough  a  data  link  from  another  aircraft 
or  from  Uie  grounti. 

The  airborne  database  is  used  for  navigation  and  a  rough  posi¬ 
tioning  of  the  sensors,  w  hich  are  then  used  for  a  precise  designa¬ 
tion  of  the  t,irget  (cross  road,  bridge...).  Airborne  databases  and 
sensors  are  alternatively  operated  according  to  the  situation  and 
the  pilot's  choice.  In  that  case  fusion  is  not  necessary,  because 
only  one  kind  of  d.tta  is  used  at  same  time;  generally  tlic  preci¬ 
sion  of  the  onboard  sensor  is  belter  than  the  precision  of  the 
localization  obtained  by  the  aircraft  localization  and  the  geo¬ 
graphical  databa.se. 

If  the  localization  of  the  geogr.iphic  l.argel  is  not  in  the  onboard 
database,  the  pilot  and  the  aircraft  system  can  designate  and 
lixtate  the  [xisition  of  the  target,  m  real  time,  with  high  precision. 
This  infonnation  is  incorixirated  into  the  on-board  database  for 
future  u,se. 

Tliis  localization  may  be  sent  to  another  aircraft  or  to  the  ground 
mission  planning  system  for  future  use.  by  J1TD.S  or  MIDS  data 
link.  Afterwards,  it  is  included  in  the  onboard  databases  of 
other  aircraft 

On  the  Ground.  Mission  planning  is  different.,  involving  more 
complex  procedures  for  merging  geographical  data.  At  first,  a 
permaneni  database  (altimetric,  planimetric,  toponymic  and 
radiometric)  is  elaborated  using  available  peacetime  techniques: 
satellites  images,  maps,  etc. 

This  iKniianent  database  is  then  completed  with  newly  collected 
data  coming  from  aircraft,  satellites,  RPVs  or  other  sources. 
This  operation  creates  several  problems  as  it  requires  handling 
of  data  of  different  ly(X's,  such  as  images,  photographs,  raw  out¬ 
puts,  etc.  Data  can  have  different  definitions  or  precisions,  and 
can  give  contradictory  information  on  the  same  feature. 
However,  they  need  to  be  merged  in  a  consistent  database  to  be 
used  for  future  missions.  For  example,  altimetry  can  be 
extracted  from  optical  sensors,  planimetry  can  be  elaborated 
from  SLAR  or  any  kind  of  airborne  sensor. 

The  pilot's  recollection  of  the  mission  is  also  useful  for  identify¬ 
ing  more  specific  objects,  giving  a  finer  description  of  them  or 
any  other  unknown  information. 

There  arc  many  benefits  to  geographical  data  fusion:  it  allows 
increased  o|x'iaiional  performance,  enhanced  spatial  resolution. 
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greater  pilot  confidence  and  reduced  mission  envionment 
ambiguity. 

6.12  Fusion  of  Data  on  Enemy  Assets. 

6.12.1  Airborne  Information  Sources. 

Embedded  Databases.  The  database  generated  during  the  pre¬ 
flight  mission  plarming  stage  contains  four  types  of  data: 

•  geographic  and  meteorological  data, 

pb  vsi'  al  and  tactical  data  about  friendly  assets, 

•  data  on  missions  and  tactics, 

•  data  on  enemy  assets. 

If  mission  replanning  is  to  be  carried  out  in  flight,  this  database 
will  have  to  be  updated  accordingly. 

JTIDS.  JTIDS  is  a  digital  information  distribution  system  pro¬ 
viding  integrated  communications,  navigation  and  identification 
capabilities.  JTIDS  participants  may  be  friendly  aircraft  well  as 
ground  based  stations.  The  data  exchanged  via  the  JTIDS 
network  would  include: 

•  changes  in  the  threat  environment 

•  mission  status  of  other  friendly  aircraft, 

•  target  tracks  detected  by  other  friendly  aircraft. 

With  respect  to  the  in  flight  data  fusion  process,  target  track  data 
received  via  JTIDS  may  be  regarded  as  data  returned  by  another 
sensor  onboard  the  aircraft  where  the  data  fusion  process  takes 
place. 

Infrared  Sensors.  Airborne  infrared  sensors  irKludc  FLIR  and 
IRST  FUR  systems  use  tne  temperature  gradient  of  an  object 
scene  to  produce  TV -like  images  at  night  as  well  as  during  the 
day.  The  pilot  uses  his  image  interpretation  skills  to  detect,  rec¬ 
ognize  and  identify  targets  of  interest.  This  identification  pro¬ 
cess  might  be  automated  by  correlating  the  FLIR  images  with  a 
bank  of  pre-stored  target  IR  signatures.  The  pilot's  intervention 
would  then  be  only  required  to  support  or  invalidate  the  decision 
reached  by  the  correlation  process. 

IRST  is  used  primarily  for  detection  of  hot  spots  in  large  volume 
searches  and  subsequent  tracking  of  designated  targets.  In  the 
tracking  mode  of  operation,  the  IRST  system  can  be  locked  onto 
a  single  target,  tracking  that  target  in  angle  or  it  can  be  used  in  a 
track-while-scan  mode,  where  several  targets  arc  tracked  by  a 
computer  and  the  IRST  system  remains  in  the  search  mode 
updating  target  angular  positions  periodically.  In  all  cases,  the 
outputs  of  the  IRST  are  the  target  2D  tracks  (angular  position 
aiKl  angular  velocity). 

Vlslbk  Sensors.  Visible  imaging  sensors  require  the  pilot's  in¬ 
tervention  to  analyze  the  displayed  scene,  especially  to  recog¬ 
nize  and  identify  targets  of  interest.  This  scene  analysis  process 
is  difficult  to  automate,  since  this  automation  involves  pattern 
recognition  techniques. 

Electronic  Support  Measures  (ESM).  ESM  involves; 

•  delecting  enemy  signal  activity, 

•  classifying  signals, 

•  calculating  emitter  locatioas. 


•  extracting  intelligence  from  operational  characteristics, 
signal  technical  characteristics  or  emitter  location. 

ESM  outputs  include  angular  location  and  indentification  for 
each  emitter. 

Microwave  Radar  and  Laser  Radar  Systems.  Future  mi¬ 
crowave  airborne  radars  will  essentially  be  multi-function. 
Their  operation  is  highly  automated,  the  pilot's  intervention 
possible  but  rarely  necessary.  In  most  modes  the  radar's  outputs 
will  consist  of  the  target  tracks.  These  tracks  will  be  2D 
(angular  localization  in  a  passi  ?  search  r.  c'le  far  oi 

3D. 

A  signature  analysis  mode  might  also  be  available.  In  this 
mode,  the  radar  performs  an  accurate  measurement  of  the  target, 
and  the  return  is  correlated  with  pre-stored  target  radar 
signatures. 

Laser  radar  systems  are  active  devices  that  operate  similarly  to 
microwave  radar  but  at  much  higher  frequencies  (1.06mm  for 
the  Na-Yag  laser  and  10.6mm  for  the  CO2  laser).  They  can  be 
used  for  accurate  target  localization  or  for  identification. 

They  can  be  used  either  in  a  detection  and  tracking  mode  where 
they  are  capable  of  tracking  w  ith  high  resolution  target  desig¬ 
nated  by  another  less  accurate  sensor,  or  in  an  imaging  mode 
where  they  can  produce  high  resolution  pictures  of  targets  and 
areas  of  the  ground. 

612  2  Airborne  Data  Fusion 

The  data  fusion  process  establishes  global  tracks  from  lltose 
produced  by  the  different  sensors  described  previously. 

The  sensor  tracks  are  combined  periodically  (at  regular  fusion 
time  points)  into  global  uacks.  Tliese  global  tracks  can  then  be 
cxtraptrlated  forward  in  time  and  made  available  for  use  when¬ 
ever  an  estimate  of  the  environment  ba.sed  on  all  scn.sors  infor¬ 
mation  is  required. 

The  organization  below  outlines  how  the  sensor  tracks  are 
combined  to  provide  global  tracks: 

•  alignment:  sensor  data  are  transformed  into  a  common 
space  and  lime  coordinate  system. 

•  association;  this  process  determines  whether  a  global 
track  .Old  a  sensor  track  reiiresent  the  same  target, 

•  u|xlating:  each  global  track  is  u(xlated.  via  a  track  fusion 
algorithm,  with  the  sensor  U.ick  it  has  been  associated 
with  at  die  previous  step 

fi  I  2  3  Differences  Between  drounii  Ba.sed  and  In-Flight 
Mission  Planning  Systems 

The  main  differences  between  ground  based  and  in  flight  mis¬ 
sion  planning  are  Uiat  ground  based  .systems  provide: 

•  Large  choice  of  possible  missions 

•  Large  amount  of  data  available 

•  .SeaMir  data  is  not  available 

•  lm|iorianl  rcsfxinse  lime  is  allowed 

•  Rased  on  communications 

•  Data  fusion  process  can  be  complex  and  difficult  to 
automate 
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The  system  must  be  robust  against  any  virus  which  could  pro¬ 
duce  data  anomalies  or  data  destruction  as  well  as  against  un¬ 
friendly  information  detection  or  unfriendly  intrusion  into  soft¬ 
ware,  especially  during  data  loading. 

6,5  POST-MISSICN  REVIEW. 

During  flight  a  lot  of  parameters  are  to  be  recorded  to  be  used 
after  the  mission.  We  can  quote: 

•  Recording  related  to  the  aircraft,  the  engirte,  and  to  the 
aircraft  systems. 

•  Recording  related  to  the  weapons  delivery  and  naviga¬ 
tion  systems. 

•  Recording  related  to  enemy  electromagnetic  threat. 

The  goals  of  the  first  type  of  recording  are  to  monitor  the  air¬ 
frame  fatigue,  the  engine,  and  to  analyze  failures,  accidents  or 
crashes.  From  the  technical  point  of  view  the  recordings  are 
used  for  maintenance  after  failure,  for  general  maintenance  and 
for  logistics. 

The  goals  of  the  second  and  the  third  types  are  operational  and 
technical.  From  the  operational  point  of  view  the  recordings  are 
used  to  analyze  mission  results,  to  perform  intelligence  data  ex¬ 
ploitation  analysis  to  complete  the  threat  database.  This  infor¬ 
mation  will  be  used  for  combat  management  and  tactics  em¬ 
ployment  and  also  for  training. 

For  these  aims  there  are  four  different  sources  of  information. 
Video  signals  which  include: 


•  landscape  cantera  with  Head  Up  Display  recepu*c!es 

•  head  level  display 

•  head  down  display 
Audio  signals  which  include: 

•  radio  communication 

•  pilot's  voice 

•  audio  warnings 
Digital  data  which  include: 

•  aircraft  parameters  and  trajectory 

•  self  protection  system  par:uneters  (threats  parameters) 

•  data  links  communications 

and  photography  and  recce  equipment.  There  are  several  means 
to  bring  these  data  down  to  the  ground: 

•  the  audio/video  recording  assembly 

•  the  mass  memory 

•  the  data  link 

To  decrease  the  pilot's  workload  it  is  useful  to  have  an  aulomalic 
recording  of  the  most  important  events  during  the  flight  updat¬ 
ing  the  data. 


Chapter  7 
Systems  Evaluation 


7.1  INTRODUCTION. 

Aircraft,  avionics  systems,  and  support  systems  all  undergo 
thorough  developmental  and  operational  test  and  evaluation 
phases.  Developmental  test  phases  allow  for  the  evaluation  of 
the  system  in  controlled  laboratory  settings.  These  phases  also 
provide  avenues  for  constrained  approximations  to  "real  world" 
simations  with  carefully  controlled  parameters  measured  in 
uncontrolled  or  oartiallv  controlled  settings  (e.g.,  developmental 
flight  testing).  Developmental  testing  allows  for  an  initial 
"shake  down"  of  the  system  before  it  progresses  in  the  acquisi¬ 
tion  cycle.  Operational  test  penods  follow  and  open  the  oppor¬ 
tunity  to  wanant  the  system  under  the  rigors  of  everyday  use. 

While  other  combat  readiness  systems  have  undergone  strict  test 
and  evaluation  phases  as  part  of  their  acquisition  processes, 
mission  plaiming  systems  have  not  been  needed  to  fulfill  this 
requirement.  Historically,  mission  plaiming  system  testing  has 
been  limited  to  independent  validation  and  verification  OV&V) 
of  the  software.  This  IV&V  often  does  not  include  a  validation 
of  the  models  driving  the  mission  plan,  no  test  of  the  hardware 
and  no  test  of  the  operator  interfaces  or  systems  integration. 
Verification  traditionally  centers  on  the  confirmation  of  the 
software,  focusing  on  the  faithfulness  of  the  code  to  achieve  the 
aim  of  the  programmer  and  the  ability  of  otlicr  programmers  to 
follow  the  code  written.  The  verification  of  the  software  is  car¬ 
ried  out  by  software  engineers  or  test  operators.  Validation  is 
the  autiicr.licaiion  of  the  mission  planning  system  including  out¬ 
put  accuracy  (performance  envelopes,  times,  fuel  expenditure) 
and  sensibility  (arc  the  outputs  sensible  in  terms  of  mission 
performance). 

12  NECK.SSITY  OF  TEST. 

The  importance  of  test  and  evaluation  of  mission  planning  sys¬ 
tems  has  largely  been  ignored  because  the  end  users  (operational 
forces)  need  the  systems.  While  other  combat  readiness  systems 
are  required  to  undergo  extensive  validation,  verification,  test 
and  evaluation  prior  to  deployment  the  operational  need  over 
comes  the  requirement  to  investigate  the  mission  planning  sys¬ 
tem  prior  to  acquisition.  Most  mission  planning  systems  arc  put 
into  service  without  any  type  of  test  or  validation  pha.se. 

Mission  planning  testing  and  evaluation  are  necessary  to  affect  a 
successful  implementation  of  the  system  in  the  operational  envi¬ 
ronment  (reference  7.3).  This  test  and  evaluation  is  required  at 
the  research  and  development  stages  as  well  as  the  operational 
test  and  evaluation  phase  to  allow  for  the  continued  improved 
performance  of  the  system  as  well  as  improving  operational 
mission  accomplishment.  Further  absence  of  testing  may  occur 
since,  initially,  testing  of  mission  planning  systems  appears  im 
possible.  Lack  of  acquisition  requirements,  poorly  stated  design 
requirements,  and  the  pressing  need  to  get  good  mission  plan 
ning  systems  out  to  users  overshadows  the  im(X)rtance  of  a  tlior 
ough  definition  of  the  parameters,  .Satisfactory  metrics  are 
therefore  dirficiilt  to  delineate  because  the  topic  area  is  not  well 
defined  or  quantified. 

Before  the  design  of  a  new  mission  planning  system  (or  the  up 
grade  of  an  older  one)  begins  systems  architecLs  ask  questions  to 
determine  the  system  requirements  and  system  objectives. 


Testers  and  evaluators  have  many  more  questions  which  may 
ultimately  be  more  difficult  to  answer  because  they  depend  on 
satisfactorily  stated  answers  to  the  designer's  questions.  These 
questions  include  performance  definition,  performance  mea¬ 
sures.  definition  of  success,  measures  of  success,  defmition  of 
failures,  failure  metrics,  part  test  versus  whole  test  of  the  sys¬ 
tem,  test  scenarios  generation  and  content  (peacetime,  potential 
escalation,  wartime),  operator  interface,  maintainability,  and  !o- 


7J  METHODOLOGY. 

7  J.  1  Areas  of  T est. 

Two  areas  of  'est  to  be  followed  include  "pushing  the  envelope" 
(to  determine  where  die  system  falls  apart)  and  exploration  of 
the  potential  of  the  system  (to  determine  the  capability  in  terms 
of  the  operational  mission,  utili/.ing  realistic  mission  scenarios). 
Both  types  of  analysis  arc  meaningful  since  the  data  from  each 
arc  relevant. 

It  is  worthwhile  to  test  mission  planning  systems  in  both  of 
these  fashions.  The  first  (testing  the  operating  envelope  of  the 
system)  demonstrates  all  that  the  system  can  accomplish. 
Becau.->c  .1  IS  not  bviund  by  operational  constraints  it  is  possible 
to  explore  the  strengths  and  weaknesses  cf  'die  software  'dial 
might  never  be  unveiled  in  the  operational  environment.  This 
data  is  intriguing  but  of  limitcil  ulilily  because  they  cannot  be 
generali/.ed  to  operational  uses.  The  second  test  type 
(o[KTationall>  driven,  "  real  world  ’  evaluation  of  the  system) 
yields  mission  data  that  is  oi.enied  to  the  types  of. questions 
operators  ask.  The  evaluator  must  be  careful  about  tire  design  of 
the  mission  scenario  used  for  test.  Tliose  scenarios  must  be  real¬ 
istic  and  opetalion.illy  oriented  Further,  they  must  cover  a  wide 
range  of  the  possible  mission',  available.  Additionally,  these 
scenarios  nuisi  cover  all  the  features  of  the  new  mission  plan¬ 
ning  system  that  make  it  superior  to  the  old  systems.  In  that 
way  the  comparison  stems  fnim  the  differences  between  the 
mission  planning  systems  ranter  than  the  different  scenarios. 
The  evaluator  diercfore  has  constrained  some  ol  the  parameters 
and  examined  the  differences  in  ihe  plans.  These  differences 
will  highlight  the  differences  in  the  mission  planning  systems 
themselves.  This  data  is  generali/ablc  since  it  is  a  comparison 
of  data  sets  generated  by  known  mission  planning  systems. 
Unfortunately  this  qualitative  compiuison  is  currently  the  only 
data  available. 

7J.2  Current  Testing  .Approaches. 

As  slated  alxive,  lesiiiig  currently  revolves  around  independent 
validation  and  verificalion  of  the  software.  In  some  cases  this 
does  not  cover  the  verification  of  the  algorithms,  only  the  capac¬ 
ity  ol  the  jirogram  to  function  without  runtime  errors.  Nothing 
to  date  has  addressed  the  robustness  of  the  mission  planner.  A 
mission  pi, inner  is  rohiisl  if  it  \  leUls  ,i  siwcessful  plan  in  spite  of 
an  iiieoriiplete  database  [  Ref  7  1 1  How  successful  the  plan  must 
tie  h.is  not  been  qii.iniiliod.  It  is  inuxirianl  to  note,  particularly 
in  a  hicrarchn ally  ordered  modular  system  (such  as  most  mis¬ 
sion  planning  systems),  that  Ihe  levels  of  the  system  must  be 
evaluated  .ind  rurlhet.  the  system  as  a  whole  must  be  tested. 


4.! 


With  the  increasing  complexity  of  mission  planning  systems,  the 
concomitant  expansion  in  diversity  of  architecture  of  the  sys¬ 
tems  (with  the  use  of  more  modular  systems),  and  the  escalating 
need  for  belter  integration  of  the  mission  planning  system  into 
the  combat  readiness  systems  (aircraft,  surface  forces  and 
grouivd  forces)  (reference  7.2)  it  is  becoming  more  critical  to  test 
at  both  the  molecular  level  (subsystems)  and  the  molar  level 
(entire  system). 

Modular  architecture's  advantages  include  ready  upgrading  with 
minimal  hardware  cost.  Further,  the  subsections  help  to  reduce 
the  obsolescence  of  the  system  by  only  requiring  partial  hard¬ 
ware  upgrades  or  retrofits  (reference  7.1).  The  increased  modu¬ 
larity  would  work  well  with  the  advanced  avionics  architectures 
currently  in  design  and  test  as  these  architectures  arc  also  modu¬ 
lar  anc  are  uesigned  for  interface  with  uilie,  .i.odular  sys'nn. 

Molecular  testing  is  especially  suited  to  a  modular  trchitccture, 
allowing  for  control  of  the  inputs  and  outputs  at  the  various 
levels  of  the  system.  Since  mission  planning  systems  are  used  at 
many  levels  (at  the  levels  of  the  individual  aircraft,  the  group, 
the  squadron,  the  unit,  the  theater)  the  tests  must  reflect  that  di¬ 
versity  of  purpose.  There  are  no  discrete  events  in  a  hierarchical 
system.  A  change  made  at  one  level  of  the  hierarchy  will  have 
trickle  down  and  trickle  up  effects  at  each  other  level  of  llic  sys¬ 
tem.  That  same  change  implemented  at  another  level  of  the 
hierarchy  will  result  in  different  consequences  at  other  stages. 
Addiuonally,  any  change  made  at  one  level  will  have  different 
effects  at  levels  above  it  m  the  hierarchy  than  at  levels  below  it. 
Therefore  any  test  must  explore  these  hierarchically  driven  dif¬ 
ferences  and  evaluate  the  significance  of  tho.se  changes  on  die 
ouicoii.cs  at  other  levels. 

733  Other  Kvaluatiuns. 

At  a  more  "nuts  and  Doles"  level  the  relative  importance  of  sucti 
details  as  hardware,  software,  and  the  human  computer  interface 
have  to  be  determined  and  evaluated.  These  tests  arc  compara¬ 
bly  easier  to  sketch  out  since  the  specifications  for  these  aspects 
of  the  systems  exist  to  detail  the  design  and  function.  Here 
again  it  is  important  to  test  the  parts  of  the  system  as  well  as  the 
system  in  its  enurety.  The  current  common  systems  approach  to 
testing  indicates  that  the  reasonable  method  would  fiKus  on  the 
software,  the  hardware  and  the  human  computer  interface  simul¬ 
taneously.  In  this  fashion  it  is  possible  to  sec  the  system  work¬ 
ing  as  a  cohesive  whole  rather  than  as  a  collection  of  modules. 

7.4  PROBLEMS. 

There  are  a  large  number  of  potential  problems  with  test  and 
evaluation  of  mission  planning  systems.  The  first  is  putting 
forth  the  requirement  for  testing.  Perhaps  the  most  immense 
problems  are  related  to  the  indeterminate  vocabulary  which 
engenders  undefined  testing  programs.  The  definitions  of 
parameters  and  measures  of  success  arc  ambiguous  and/or 
nonexistent.  Without  these  definitions  it  will  continue  to  be  im¬ 
possible  to  successfully  evaluate  any  system.  Some  of  the 
parameters  that  require  definition  include  acceptable  probability 
of  success,  probability  of  kills,  logistical  values  (acceptable  fuel 
expended,  munitions  utilized,  system  failures,  mean  time 
between  failure),  acceptable  reroutes  in  flight  (will  reroutes  be 
acceptable  in-flight  or  will  all  planning  of  necessity  be  ground 
based?),  alternatives  (should  targets  become  unavailable  due  to 
previous  successful  missions,  inappropriate  intelligence,  or 
unforeseen  problems  en  route).  Further  performance  measures 
should  include  reduced  mission  planning  time,  operator 


satisfaction  with  the  output,  and  sy.stems  integration  with  other 
systems  in  the  platform. 

Portions  of  this  ambiguity  arc  driven  by  the  diversity  of  mis¬ 
sions,  options,  and  strategies  to  be  addressed  by  mission  plan¬ 
ning  systems.  This  returns  us  to  the  messy  analyses  that  arise 
from  having  unbounded  parameter  sets.  The  modular  architec¬ 
ture  further  clouds  the  issue  as  test  results  at  one  level  do  not 
reflect  outcomes  of  tlie  same  lest  at  other  levels. 

There  is  a  requirement  to  improve  mission  planning  system  lest 
and  evaluation.  It  is  evident  tliat  the  current  plans  for  evaluation 
of  these  systems  are  inadequate.  Future  testing  must  focus  on 
the  definitions  of  parameters  a  id  the  mission  relation  of  all  lest 
articles  so  that  the  data  are  both  inlere.sting  and  useful  to  the 
evaluators,  and  ullime'ely.  the  users. 

7.5  POTENTIAL  AREAS  FOR  R&D. 

As  die  modularity  and  hierarchy  of  the  systems  increase  the 
eomplexily  of  the  testing  required  may  appear  daunting.  T7ie 
number  of  potential  options  yield  impossible  designs  that  carmot 
be  easily  comprehended  or  easily  analy/ed.  Fortunately  the 
same  lechnxlogies  that  drive  ihe  increasing  complexity  of  the 
mission  planning  systems  have  also  touched  the  testing  area. 

There  are  a  mimlx'r  of  iHUenlia!  test  and  eviluation  tools  i.ncliuj 
ing  intelligent  lesiitig  and  mission  simulation.  These  instru¬ 
ments  could  allow  evaluators  a  belter  view  of  the  mi.ssion  plan¬ 
ning  system  by  forcing  the  detinuion  of  reipiiremenls  and  mea¬ 
sures.  Further,  they  allow  for  more  bro.id  reaching  data  collec¬ 
tion  as  lliey  are  ine.vper.sive  and  effective 

Some  basic  leneLs  of  testing  h.old  true  regardless  of  the  improved 
performance  of  the  technology.  Controlled  oxpienmenlal 
designs  aie  h.'lpbil  m  delemiining  eause  and  effect  relationships 
in  data  a.i  w  -ll  as  helping  to  establish  interactions  evidenced  in 
the  outcomes.  These  l>4>e.s  of  tiesigns  do  not  lend  themselves  to 
most  operational  test  and  evaluation  siiualicrtr  'imply  bccau.se 
the  number  of  par.imeicrs  is  very  large  and  the  number  of  levels 
of  e.ieli  parameter  may  be  infimto.  Modified  methodological 
designs  can  be  used  but  even  these  are  difficult  to  fit  into  most 
oix-ration.illy  detennmed  tests. 

7.5.1  Intelligent  Testing. 

Intelligent  testing  is  a  procedure  in  which  an  export  system  is 
used  to  design  an  experiment  that  lakes  into  account  all  a,spects 
of  each  variable  The  expert  system  is  given  all  the  rules  and 
models  with  which  to  work.  Because  the  experiment  is  a  simu¬ 
lation  of  all  the  variables  but  without  a  man  in-lhe-loop,  it  is 
possible  to  collect  data  on  all  combinations  of  parameters  with¬ 
out  exorbitant  cost.  By  mapping  out  all  the  simulation  data  over 
lime  a  surface  is  generated.  Sharp  peaks  and  valleys  on  the  sur¬ 
face  indicate  areas  of  interest  that  can  be  explored  via  more 
expensive  laKiralory  and/or  field  le.simg. 

Intelligent  testing  allows  the  user  to  lest  all  possible  combina¬ 
tions  of  the  parameters,  while  conserving  funding.  The  outcome 
then  illustrates  to  the  investigator  the  areas  of  interest  that 
should  be  explored  more  thoroughly  through  man-in-the-Ioop 
simulation  and  later  in  more  traditional  methodologies. 

7J.2  Mixsiun  .Simulation. 

Man -in -the -loop  simulation  allows  for  test  of  a  large  number  of 
parameters.  Usefulness  of  the  output  may  be  the  most  telling 


qualificaiion  of  a  mission  planner  if  an  appropriate  measurc»is 
determined  and  utilized.  Man-in-the-loop  simulation  is  a  useful 
and  acceptable  methodology  in  research,  test,  and  evaluation 
because  it  allows  a  brge  number  of  parameters  to  be  tested  in  a 
restricted  test  space  in  a  highly  controlled  experiment. 
Collecting  data  from  a  controlled  experimental  methodology 
allows  for  collection  of  vital  data  that  are  difficult  or  impossible 
to  collect  in  operational  settings  (in-flight  or  underway).  For 
systems  such  as  mission  planners,  man-in-the-loop  simulation 
allows  for  more  expedient,  less  expensive  test  of  the  output  plan 
covering  more  varied  missions.  Further,  this  method  allows  for 


safe  data  collection  and  gets  the  operator  into  the  loop.  At  this 
stage  of  testing  the  operator  inputs  can  be  meaningfully  incorpo- 
ratetl  into  evaluation  of  the  system. 

Tlie  combination  of  intelligent  testing  and  mission  simulation 
allows  for  efficient,  cost  effective  test  of  the  entire  system.  The 
data  from  these  tests  allow  the  evaluators  to  structure  the  exper¬ 
iments  ainducted  in  developmental  test  phases  and  in  the  oper¬ 
ational  test  phase  so  that  the  most  useful  information  is  gathered 
in  the  most  productive  manner. 


Chapter  8 
Conclusions 


4? 


8.1  INTRODUCTION. 

This  report  covers  the  Phase  Two  activities  of  the  Working 
Group  during  which  the  preliminary  findings  of  Phase  One  were 
explored  in  greater  depth.  The  Phase  Two  studies  have  not  re¬ 
sulted  in  a  well-defined  path  for  the  development  of  mission 
plaiming  systems,  but  rather  a  whole  range  of  possibilities  has 
been  identified  from  which  systems  to  meet  particular  require- 
rr?"ts  can  be  develrp'-d. 

The  following  sections  summarize  the  most  outstanding  con¬ 
clusions  of  the  Working  Group.  These  conclusions  are  struc¬ 
tured  according  to  mission  stage:  pre-flight,  in-flight  or  post¬ 
flight.  Conclusions  on  pre-flight  applications  include  mission 
planning,  mission  rehearsal  and  training  (Sections  8.2.1.  and 
8.2.2).  Mission  planning  support  in-flight  includes  various  crew 
assisting  activities  (Section  8.3).  Post-flight  use  of  mission 
planning  systems  is  equivalent  to  mission  evaluation  providing 
input  for  subsequent  missions  (Section  8.4). 

Sections  8.2  to  8.4  distinguish  various  applications  of  mission 
planning  systems:  preflight  (planning,  training,  rehearsal), 
inflight,  and  post-flight;  there  should  be  a  generic  concept  that 
integrates  these  applications  in  one  concept. 

PRE-FLIGHT. 

8.2.1  MLs.sian  Planning. 

Pre-flight  planning  tasks  have  been  investigated  and  described 
since  the  70's.  and  led  to  the  development  of  numerous  pre¬ 
flight  planning  systems.  A  variety  of  automated  tools  for  pre¬ 
flight  mission  planning  is  already  being  developed  or  opera¬ 
tional.  Anacapa  Sciences  conducted  a  review  of  the  relevant  lit¬ 
erature  compilmg  a  comprehensive  list  of  specific  infomiation 
that  must  be  coasidered  during  mission  planning.  The  NAFAG 
distributed  a  questionnaire  to  collect  data  on  the  status  of  mis 
sion  plarming  aystems.  Conclusions  of  these  enquiries  that 
proved  relevant  to  this  Working  Group  are  summari/cd  in 
Section  1.2.1. 

Joint  Working  Group  15  has  not  compared  existing  mission 
planning  systems  in  greater  detail,  as  that  was  considered  of 
limited  additional  benefit  at  the  cost  of  an  extensive  amount  of 
additional  effort. 

Mission  planning  systems  differ  widely  in  capabilities.  Tbis  is 
due  to  the  lack  of  a  unique  definition  or  specification  of  capa¬ 
bilities  that  constitute  a  mission  planning  sys'em.  Most  litera¬ 
ture  on  mission  planning  systems  addresses  only  the  computa¬ 
tional  approaches  of  route  planning  (fuel  consumption,  attrition 
risks);  this  rcprc.senLs  only  part  of  the  mission  planning  priKcss. 

The  changed  military  scene  may  require  some  additional  capa¬ 
bilities  to  the  present  mission  planrung  systems: 

•  future  conflicts  may  arise  in  areas  for  which  the  avail 
able  databases  may  be  inadequate  for  mission  planning, 
hence  needing  a  rapid  update.  .Such  updates  may  be  by 
satellite,  aerial  reconnaissance,  nr  a  fusion  of  these  and 
other  data.  Such  a  requirement  has  been  specified  for 
the  SGF  MRS. 


•  interoperability  experiences  in  "Desert  Storm  "  have  not 
been  encouraging  (see  Section  1.2.2).  There  is  a  grow¬ 
ing  importance  of  interoirerability  in  mission  planning 
systems  between  force  types,  nations,  command  and 
control  levels,  and  platform  types. 

Existing  pre-flight  mission  planning  systems  have  reached  a 
stage  of  maturity  at  which  it  seems  unrealistic  to  expect  that 
interoperability  issues  can  be  resolved  with  systems  of  the  pre¬ 
sent  generation;  agreements  on  a  high  level  architecture  of  com¬ 
ponents  of  mission  planning  systems  and  their  interfaces  (pre- 
flight  or  in-flight)  should  facilitate  the  exchange  of  components 
and  should  enable  concentration  on  the  development  of  isolated 
components. 

Introduction  of  greater  comput.itional  capabilities  is  expected  to 
allow  greater  emphasis  on  areas  such  as  data  lusion  and  battle¬ 
field  prediction  (Chapter  6) 

8.2.2  .Mission  Rehearsal  and  Training. 

Conuary  to  preparing  for  a  eonDiel  between  N'/.TO  and  Warsaw- 
Pact  forces  in  Europe,  it  may  not  be  possible  to  uain  and 
rehearse  in  regiorus  of  future  coiifiieLs  (section  1.2.2).  The  oper¬ 
ational  cnvironnicm  may  not  be  defined,  it  may  not  be  possible 
to  train  in  a  comparable  environment.  This  iack  of  an  environ¬ 
ment  for  oirerational  training  indicates  the  growing  importance 
of  systems  for  rehearsal. 

Experiences  with  mission  rehearsal  lor  "Desert  Storm  "  have 
been  encouraging  (see  Section  1.2.2).  For  future  procurement, 
mission  rehearsal  trainers  have  to  be  able  to  be  reconfigured 
quickly  from  one  aircraft  to  aimtlier  and  be  as  deployable  as  the 
forces  themselves  (see  Section  3.6).  .Aircraft  carriers  are  one 
means  of  transporting  and  hosting  both  these  firrees  and  their 
deployable  mission  planning  systems.  TTie  capability  for  pre- 
flight  mission  rehearsal  is  expected  to  become  more  available  as 
the  machine  capabilities  increase.  This  is  seen  as  a  major  factor 
increasing  missurn  effectiveness.  If  "  rehearsal  "  is  for  a  non 
specilic  la.sk.  then  iliis  is  nonnaiiy  reg.irded  as  training. 

H-3  IN-FLHiHl. 

Pruir  to  concluiimg  in-night  pianmng.  it  should  lx;  clear  which 
tasks  are  part  ol  mission  planning  and  w  hich  are  part  of  tactics 
that  may  be  iraineil  or  rehearsevi,  see  Section  8.2.2.  Rerouting 
as  a  consequence  of  threat  avoidance  may  be  considered  tactics 
instead  ol  an  in  lliglu  replanning  activity. 

In  night  mission  pl.inning  resembles  pre  flight  planning  but  is 
IK-rformed  while  a  pilot  is  performing  other  tasks  that  may  be 
more  imixirlant.  Tune  constraints  .ind  pilot  workload  require  a 
management  capability  that  assigns  priorities  to  tasks.  A  previ¬ 
ous  AGAKD  working  group  tWG  7,  |1.6|)  has  already 
addresserl  this  suh|ect 

The  Phase  One  rejxirt  (Chapter  4)  has  (xiintcd  out  the  difficulties 
of  in  night  planning  The  majority  of  die  problems  arc  in  com 
munication.  coordination,  and  identification: 

•  communication  reqiiiies  a  ^ecu^e.  iiniiunmahle  data  link 


•  Close  Air  Su|i))0[(  missions  rcriuire  coordination  wiili 
the  army  ,  air  defense  missions  have  to  be  coordinated 
witli  other  units  (surface-to-air  defense  systems,  other 
controlling  agencies) 

•  t)cfore  attacking  it,  identification  of  a  target  always  has 
been  important,  but  nowadays  tlic  effective  range  of 
(stand-ofO  weapons  is  too  great  to  identify  the  target 
visually.  Identification  is  especially  delicate  in  CAS 
missions  because  the  ground  troops  arc  in  a  contact  situ¬ 
ation.  Hence  the  requirement  for  up-to-date  intelligence 
data  to  be  available  U)  the  pilot. 

Deconfliction  and  target  assignment  in  air-to-air  an.l  Close  Air 
Supixirt  missions  are  mission  planning  functions  that  cannot  be 
planned  preflight  (e.g.,  Phase  One  report).  As  a  coriscquence, 
these  mission  tyj>es  are  only  partially  supported  by  present  pre- 
flight  mission  planning  systems  (except  for  the  route  planning 
function,  see  Chapter  1).  “Desert  Suirm"  has  demonstrated  that 
in-flight  iqxlating  of  databases  under  certain  circumstances  is  a 
reli  iblc  concept  for  air-to-ground  missions  (section  1 .2.2),  and 
full :je  technologies  may  allow  a  shift  of  tasks  from  the  tasking 
agency,  the  interceptor  controller  and  die  ground  liaison  officer 
to  die  crew  in  die  mission  aircraft. 

In- flight  plannuig  may  lie  canied  out  by: 

•  die  aircrew 

•  a  planning  team,  in  anodter  aircraft  (c.g.,  odier  aircraft 
of  the  flight  or  an  AWACS) 

•  a  planning  team  on  the  ground  (c.g.,  a  fighter  controller 
in  a  bunker  or  a  forward  air  controller  in  the  battlefield). 

If  the  planner  is  in  an  ABCCC/AWACS/JSTARS  air¬ 
craft  the  MPS  may  have  the  same  capabilities  as  a 
ground  based  system. 

Tltc  cuneni  slate -of-thc-art  of  in-flight  planning  is  limited  to  rc- 
plarming  a  mission  by  using  options  that  have  already  been 
planned  pre-flight;  examples  arc  the  attacking  of  alicmativc  tar¬ 
gets,  execution  of  system  failure  procedures. 

As  far  as  the  interface  is  concerned  for  in-flight  MPS,  it  must  be 
pointed  out  that  it  is  not  conceivable  in  tactical  aircraft  to  have  a 
dedicated  interface,  but  the  same  multi  function  displays  and 
controls  used  for  other  mission  t.asks  shall  be  used  for  mission 
planning  (sec  Chapter  4).  In  addition,  a  commonality  in  formats 
and  symbologies  should  be  pursued.  It  is  likely  that  in  most 
cases  the  mission  planning  task  will  not  be  the  siring  factor  in 
cockpit  design,  rather,  the  available  cockpit  lay-out  will  strongly 
influence  the  pilot  /  MP.S  interaction  capabilities. 

So,  the  in-flight  MPS  shall  cope  with  die  following  additional 
con.slraiiits; 

•  minimi/c  pilot  attention  and  workload  rc(|uiicments  - 

•  avoid  interference  with  odicr  primary  mission  tasks 

•  Ik:  sufficiently  reliable  in  its  automated  functions  to  gain 
complete  pilot  acceptance 

•  KHiimunicatc  widi  the  pilot  through  })liysicai  and  logical 
intcrraccs  designed  |iriinarily  for  other  la.sks  (except  for 
parliculur  c.xscs). 

(f  the  mission  planner  is  (he  aircraft  crew,  it  could  he  useful  to 
have  a  commonality  in  interface  and  function,  both  on  board  and 
on  the  ground.  If  diis  system  is  to  he  used  for  otlier  aircraft 
tyjics  as  well,  however,  this  may  result  in  intcroiKrahility  diffi¬ 


culties  due  to  (he  existing  ditforence:;  between  inlerf.ice5  and 
functions  in  different  aircraft  types  (see  Section  1 .2.3). 

•So  a  dichotomy  can  be  foreseen  lietween  the  interoperability 
rcciuircmenls  and  (he  integration  of  such  systems  widi  the  entire 
system.  In  fact,  future  aircraft  will  not  incluilc  a  physically  dis¬ 
tinct  mission  planning  system,  but  a  mission  planning  function 
widiin  the  overall  integrated  avionics  system. 

In  ongoing  programs,  in-flight  mission  planning  is  not  regarded 
as  a  separate  subject,  but  is  integrated  in  covering  crew-assistant 
programs  (PA,  CE,  MMA  (.see  section  1 .3.2));  mis.sion  planning 
in  these  programs  is  an  important  function  within  the  overall 
system.  Although  diesc  ongoing  crew-asslsianl  programs  seem 
a  good  starting  point  for  future  developments,  their  different 
architectures  may  hinder  future  joint  production  of  crew  assis¬ 
tant  systems.  .Such  a  joint  prt/iluction  may  he  a  must  in  order  to 
reduce  development  costs  and  to  meet  NATO's  future  force 
stfucture  concept;  in  this  new  concept  small  force  units  of  vari¬ 
ous  nations  slioiitd  ciKiperate  at  s(|uadron  level,  m.iking  interop¬ 
erability  an  even  more  important  aspect.  'Die  basis  of  such  a 
joint  production  is  a  common  concept  of  crew  assistant  func¬ 
tions.  which  could  be  defined  on  the  basis  of  commonalities  in 
tlie  architectures  of  PA,  CE  and  MMA. 

K.4  P(».Sr-rLI(lHT. 

The  capabilities  of  the  jxist-fliglit  functions  of  mission  planning 
systems  as  described  in  Section  6.5  are  expected  to  increa.se. 
TIic  increasing  amounts  of  data  collected  and  recorded  during  u 
mission  will  need  to  lie  led  into  the  C^l  network  rapidly  to 
ensure  that  further  missions  are  planned  on  the  basis  of  up-to- 
date  information.  This  may  require  improved  brief  and  debrief 
facilities  as  well  as  mission  rehearsal  capabilities. 

K.5  KPILODin,. 

In  the  Phase  One  report  is  was  stated  that  "mission  planning 
doctrirtc  and  technology  has  lagged  far  behind  many  of  tlic  air¬ 
craft  teclinology  developments  since  World  War  11".  Tltcrc  are 
indications  that  this  situation  is  changing,  and  there  arc  now 
strong  ixiiiileis  to  a  more  realistic  appreciation  of  tlic  value  of 
advanced  mission  planning  systems  and  their  inclusion  in  pro¬ 
grams  like  Copilole  Electroniquc,  Pilot's  Associate,  Mission 
Managenunt  Aid.  Of  the  many  possible  reasons  for  this,  it  is 
likely  that  the  most  imixiriam  is  a  re  appraisal  of  military  needs 
following  the  collapse  of  die  Warsaw  Pact  forces  and  the  cx|x:ri- 
cncc  of  0|x.Taiion  “Desert  .Storm''.  Also  important  is  the  fact 
that  appropriate  hardware  and  software  are  now  commercially 
available  at  relatively  low  cost.  Alsti,  as  rc.sourccs  arc  reduced, 
efficient  mission  planning  is  regardeil  as  a  force  multiplier. 

1'hc  rapid  developments  in  computer  hardware  and  software, 
logcdicr  with  parallel  developments  of  their  associated  periph¬ 
erals  such  as  displays,  have  been  generated  by  strong  commer¬ 
cial  pressures  in  a  very  large  siKchum  of  civil  markcis  and, 
although  this  may  not  continue  ui  its  present  rate  indefinitely,  it 
can  lie  prcdicletl  dial  in  these  technical  areas  there  will  he  suffi¬ 
cient  future  progress  lo  mcci  foreseeable  needs  of  most  military 
mission  planning  system  designers  at  much  lower  costs  Utan 
would  be  ixissihlc  using  technology  designed  specifically  for  the 
very  narrow  market  of  mission  planning  systems.  An  important 
(ask  for  further  research  anti  devclopmcnl  must  therefore  con¬ 
sider  (he  {xissibility  of  atlapliiig  diis  improved  technology  to  the 
particular  needs  of  military  mission  |>lanning.  Topics  which 
ajtpear  lo  be  of  primary  irnixirtance  are 
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•  overall  system  analysis,  including  detailed  study  of  the 
tasks  to  be  carried  out  by  man  and  machine  (Chapter  3) 

•  performance  specification,  which  will  permit  proper  test 
and  evaluation  (Ch'^nler  7) 

•  proper  analysis  of  the  benefits  of  mission  rehearsal, 
either  through  the  use  of  a  mission  planning  system 
having  this  inherent  capability  or  by  the  use  of  a  sepa¬ 
rate,  specific  mission  rehearsal  system  (Chapter  1) 

•  cost  /  benefit  studies  to  allow  proper  choice  between  the 
wide  range  of  alternative  performance  levels  which  will 
become  available. 

The  types  of  analytical  study  listed  above,  particularly  those 
involving  measurements  of  human  performance  in  operational 
conditions,  axe  inherently  difficult.  The  situation  has  as  its  par¬ 
allel  the  need  for  research  on  the  value  of  training  simulators: 


this  has  generally  been  carried  out  in  an  empirical  and  evolu¬ 
tionary  way  rather  than  by  systematic  analysis. 

Finally,  mention  must  be  made  of  the  topic  of  interoperability,  a 
problem  highlighte  in  "Desert  Storm"  (see  Section  1.2.2). 
Because  this  was  a  subject  studied  by  NAFAG,  the  Working 
Group  has  not  given  it  the  attention  which  it  would  otherwise 
deserve.  But  it  has  to  be  clearly  understood  that  it  presents  a 
major  difficulty,  primarily  because  mission  plarming  systems 
will  almost  certainly  have  features  which  are  specific  to  th* 
avionics  equipment  fitted  to  particular  types  of  aircraft.  As 
avionics  becomes  more  complex,  and  more  "intelligence"  is 
incorporated,  the  need  will  increase  for  properly  matched  intel¬ 
ligence  in  each  mission  planning  system,  creating  problems  in 
attaining  iiu>;r:'perability.  Modem  computer  systems  may  make 
it  possible  to  combine  specificity  with  interoperability,  but  the 
combination  of  these  two  attributes  w  ill  not  be  easy 
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14.  Abstract 

Mission  Planning  is  not  new  in  concept,  and  as  applied  to  military  aircraft  missions,  it  must  have 
been  carried  out  from  the  very  earliest  days.  Recent  events  have  combined  to  increase  interest  in 
the  subject,  and  the  Air  Forces  of  many  of  the  NATO  nations  are  taking  steps  to  develop  and 
procure  mission  planning  systems  that  have  capabilities  far  in  advance  of  those  previously 
available.  In  addition,  increased  interest  is  being  shown  in  using  airborne  computer-based  systems 
to  plan  and  re-plan  missions  w  hile  they  arc  in  progress.  j 
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This  report  describes  the  Phase  2  work  «if  the  AMP/AVP  Joint  Working  Group  1 5  on  ! 

Mission  Planning  Systems  and  follows  on  from  the  Phase  1  report  which  was  published  as 
AGARD-AR-296. 
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